-- Logs begin at Sat 2022-04-02 20:01:18 UTC, end at Sat 2022-04-02 22:19:51 UTC. --
Apr 02 20:42:33.854360 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Apr 02 20:42:37.301366 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=129611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}}
Apr 02 20:42:37.302026 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=129611) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 02 20:42:37.677443 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_db.sqlalchemy.engines [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 02 20:42:37.994293 ncdv-master-1 cinder-volume[129611]: INFO cinder.rpc [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 02 20:42:38.001020 ncdv-master-1 cinder-volume[129611]: INFO cinder.rpc [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 02 20:42:38.010064 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_db.sqlalchemy.engines [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 02 20:42:38.077356 ncdv-master-1 cinder-volume[129611]: INFO cinder.volume.manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Determined volume DB was empty at startup.
Apr 02 20:42:38.077976 ncdv-master-1 cinder-volume[129611]: DEBUG cinder.volume.manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=129611) __init__ /opt/stack/cinder/cinder/volume/manager.py:286}}
Apr 02 20:42:38.085900 ncdv-master-1 cinder-volume[129611]: INFO cinder.volume.manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 02 20:42:38.087216 ncdv-master-1 cinder-volume[129611]: WARNING stevedore.named [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 20:42:38.087647 ncdv-master-1 cinder-volume[129611]: WARNING castellan.key_manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 20:42:38.088804 ncdv-master-1 cinder-volume[129611]: WARNING cinder.keymgr.conf_key_mgr [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 20:42:38.105477 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_db.sqlalchemy.engines [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 02 20:42:38.109753 ncdv-master-1 cinder-volume[129611]: INFO cinder.rpc [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 02 20:42:38.113352 ncdv-master-1 cinder-volume[129611]: INFO cinder.rpc [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Apr 02 20:42:38.114007 ncdv-master-1 cinder-volume[129611]: WARNING stevedore.named [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 20:42:38.114410 ncdv-master-1 cinder-volume[129611]: WARNING castellan.key_manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 20:42:38.116086 ncdv-master-1 cinder-volume[129611]: INFO cinder.volume.manager [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Apr 02 20:42:38.121694 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_db.sqlalchemy.engines [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129611) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 02 20:42:38.139209 ncdv-master-1 cinder-volume[129611]: INFO oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Starting 1 workers
Apr 02 20:42:38.144577 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Started child 129783 {{(pid=129611) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Apr 02 20:42:38.146023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Full set of CONF: {{(pid=129611) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Apr 02 20:42:38.146695 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ******************************************************************************** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Apr 02 20:42:38.147393 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] Configuration options gathered from: {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Apr 02 20:42:38.148149 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Apr 02 20:42:38.149399 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Apr 02 20:42:38.150086 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ================================================================================ {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Apr 02 20:42:38.151479 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] allow_availability_zone_fallback = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.152068 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] allow_compression_on_image_upload = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.153598 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] allowed_direct_url_schemes     = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.154206 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] api_rate_limit                 = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.154878 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] auth_strategy                  = keystone {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.155463 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] az_cache_duration              = 3600 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.156049 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_availability_zone      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.156734 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_host                   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.157314 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_name                   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.158061 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_stats_polling_interval = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.158576 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backup_api_class               = cinder.backup.api.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.159113 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.159695 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backup_name_template           = backup-%s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.160238 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backup_use_same_host           = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.160798 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backup_use_temp_snapshot       = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.161336 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] chap_password                  = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.161861 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] chap_username                  =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.162391 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.163060 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_internal_tenant_project_id = dc74fe8a08da402d9cd82fd42d3f8f20 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.163650 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_internal_tenant_user_id = 64e876b0e0844090aa652c98af67ab8b {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.164177 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cloned_volume_same_az          = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.165256 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cluster                        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.165807 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] compression_format             = gzip {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.166360 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] compute_api_class              = cinder.compute.nova.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.166467 ncdv-master-1 cinder-volume[129783]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Apr 02 20:42:38.167456 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] config_dir                     = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.167911 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.168500 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] config_source                  = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.169021 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.169581 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] control_exchange               = openstack {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.170162 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] debug                          = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.170657 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] default_availability_zone      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.171208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] default_group_type             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.172072 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.173686 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] default_volume_type            = ceph {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.174304 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_client_cert             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.174895 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_client_cert_key         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.175470 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_data_namespace          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.176044 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_ssl_cert_path           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.176636 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_ssl_cert_verify         = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.177198 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] driver_use_ssl                 = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.177798 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] enable_force_upload            = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.178335 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] enable_new_services            = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.178898 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] enable_unsupported_driver      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.179516 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] enabled_backends               = ['ceph'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.180192 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] enforce_multipath_for_image_xfer = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.181292 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] filter_function                = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.181852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_api_insecure            = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.182474 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_api_servers             = ['http://10.222.0.18/image'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.183065 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_api_ssl_compression     = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.183636 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_ca_certificates_file    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.184234 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_catalog_info            = image:glance:publicURL {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.184849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_certfile                = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.185586 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.186160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_keyfile                 = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.186751 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_num_retries             = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.187313 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] glance_request_timeout         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.187876 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] goodness_function              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.188487 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] graceful_shutdown_timeout      = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.189070 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] group_api_class                = cinder.group.api.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.189581 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] host                           = ncdv-master-1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.190161 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.190762 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_compress_on_upload       = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.191339 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_conversion_address_space_limit = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.191940 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_conversion_cpu_limit     = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.192719 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.193352 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_upload_use_cinder_backend = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.193937 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_upload_use_internal_tenant = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.194536 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_volume_cache_enabled     = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.195109 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_volume_cache_max_count   = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.195705 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] image_volume_cache_max_size_gb = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.196300 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] init_host_max_objects_retrieval = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] instance_format                = [instance: %(uuid)s]  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iscsi_iotype                   = fileio {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iscsi_secondary_ip_addresses   = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iscsi_target_flags             =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iscsi_write_cache              = on {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.320023 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iser_helper                    = tgtadm {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iser_ip_address                = 10.222.0.18 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iser_port                      = 3260 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_config_append              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.321575 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_dir                        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322345 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_file                       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322345 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_options                    = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322491 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Starting volume driver RBDDriver (1.2.0)
Apr 02 20:42:38.322572 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_rotate_interval            = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322572 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_rotate_interval_type       = days {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322572 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] log_rotation_type              = none {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322572 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322572 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.322996 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323081 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] max_age                        = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] max_logfile_count              = 30 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] max_logfile_size_mb            = 200 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] max_over_subscription_ratio    = 20.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] message_reap_interval          = 86400 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] message_ttl                    = 2592000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] migration_create_volume_timeout_secs = 300 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] monkey_patch                   = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] monkey_patch_modules           = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] my_ip                          = 10.222.0.18 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.323562 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] no_snapshot_gb_quota           = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] num_iser_scan_tries            = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] num_shell_tries                = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] num_volume_device_scan_tries   = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] nvmet_ns_id                    = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] nvmet_port_id                  = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_max_limit                = 1000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324032 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_ext_list          = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_listen_port       = 8776 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_use_ssl           = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] osapi_volume_workers           = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324533 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] per_volume_size_limit          = -1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] periodic_fuzzy_delay           = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] periodic_interval              = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] public_endpoint                = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] publish_errors                 = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_backup_gigabytes         = 1000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.324951 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_backups                  = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_consistencygroups        = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_gigabytes                = 1000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_groups                   = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_snapshots                = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] quota_volumes                  = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325386 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] rate_limit_burst               = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] rate_limit_except_level        = CRITICAL {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] rate_limit_interval            = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] reinit_driver_count            = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] replication_device             = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] report_discard_supported       = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] report_interval                = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.325838 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] reservation_clean_interval     = 86400 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] reservation_expire             = 86400 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] reserved_percentage            = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] rpc_response_timeout           = 120 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326297 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] run_external_periodic_tasks    = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] scst_target_driver             = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] scst_target_iqn_name           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_down_time              = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] snapshot_name_template         = snapshot-%s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.326687 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] snapshot_same_host             = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] split_loggers                  = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] state_path                     = /opt/stack/data/cinder {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] storage_availability_zone      = nova {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] storage_protocol               = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] syslog_log_facility            = LOG_USER {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327041 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] target_helper                  = lioadm {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] target_ip_address              = 10.222.0.18 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] target_port                    = 3260 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] target_protocol                = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] trace_flags                    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] transport_url                  = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] until_refresh                  = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_chap_auth                  = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_default_quota_class        = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_eventlog                   = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_journal                    = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.327796 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_json                       = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_multipath_for_image_xfer   = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_stderr                     = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] use_syslog                     = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] verify_glance_signatures       = enabled {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_api_class               = cinder.volume.api.API {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_backend_name            = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328225 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_clear                   = zero {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_clear_ionice            = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_clear_size              = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_copy_bps_limit          = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_dd_blocksize            = 1M {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.328704 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_name_template           = volume-%s {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_service_inithost_offload = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volume_usage_audit_period      = month {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] watch_log_file                 = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] zoning_mode                    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.enforce_new_defaults = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.enforce_scope      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.policy_default_rule = default {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329476 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.policy_file        = policy.yaml {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.329852 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_concurrency.disable_process_locking = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.admin_password = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.admin_token = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330226 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.admin_user  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_port   = 35357 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_protocol = https {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_section = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_type   = password {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.330609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_uri    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.auth_version = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.cache       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.certfile    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.delay_auth_decision = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331073 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.http_connect_timeout = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.identity_uri = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.include_service_catalog = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.insecure    = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.interface   = public {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.keyfile     = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.331835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.region_name = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.332229 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.service_token_roles_required = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.service_type = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.token_cache_time = 300 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.backend                  = dogpile.cache.null {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.334853 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.backend_argument         = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.config_prefix            = cache.oslo {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.dead_timeout             = 60.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.debug_cache_backend      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.enable_retry_client      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.enable_socket_keepalive  = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.enabled                  = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.335676 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.expiration_time          = 600 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.hashclient_retry_attempts = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_dead_retry      = 300 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_pool_maxsize    = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.336783 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.337874 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.337874 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.proxies                  = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.retry_attempts           = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.retry_delay              = 0.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.socket_keepalive_count   = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.socket_keepalive_idle    = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.socket_keepalive_interval = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.338346 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.tls_allowed_ciphers      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.tls_cafile               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.tls_certfile             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.tls_enabled              = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cache.tls_keyfile              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] coordination.backend_url       = etcd3+http://10.222.0.18:2379 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.backend               = sqlalchemy {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.339326 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.connection            = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.connection_debug      = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.connection_parameters =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.connection_recycle_time = 3600 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.connection_trace      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.db_inc_retry_interval = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.db_max_retries        = 20 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.340260 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.db_max_retry_interval = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.db_retry_interval     = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.max_overflow          = 50 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.max_pool_size         = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.max_retries           = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.mysql_enable_ndb      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.341331 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.pool_timeout          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.retry_interval        = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.slave_connection      = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.sqlite_synchronous    = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] database.use_db_reconnect      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.342267 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.connection_string     = messaging:// {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.enabled               = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.es_doc_type           = notification {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.343208 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.es_scroll_size        = 10000 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.es_scroll_time        = 2m {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.filter_error_trace    = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.hmac_keys             = SECRET_KEY {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.sentinel_service_name = mymaster {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.socket_timeout        = 0.1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] profiler.trace_sqlalchemy      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344011 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.capabilities   = [21] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.group          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.helper_command = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] privsep_osbrick.user           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.344959 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.group         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.helper_command = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] cinder_sys_admin.user          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.auth_section      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.auth_type         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.345888 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.cafile            = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.certfile          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.collect_timing    = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.insecure          = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.keyfile           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.send_service_user_token = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.split_loggers     = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.346849 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] service_user.timeout           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.backend_availability_zone = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.chap_password = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.chap_username =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.347831 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_client_cert = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_client_cert_key = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_data_namespace = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.348723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.driver_use_ssl = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.enable_deferred_deletion = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.enable_unsupported_driver = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.349531 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.extra_capabilities = {} {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.filter_function = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.goodness_function = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.350333 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iscsi_target_flags =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.351160 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iscsi_write_cache = on {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.352499 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iser_helper   = tgtadm {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.352499 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iser_ip_address = 10.222.0.18 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.352499 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iser_port     = 3260 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.352499 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.num_shell_tries = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.nvmet_port_id = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.353279 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rados_connect_timeout = -1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rados_connection_interval = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rados_connection_retries = 3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_ceph_conf =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_cluster_name = ceph {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.354231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_pool      = rbd {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_secret_uuid = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.rbd_user      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.replication_connect_timeout = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.355373 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.replication_device = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.report_discard_supported = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.reserved_percentage = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.scst_target_driver = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.scst_target_iqn_name = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.356934 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.storage_protocol = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.target_helper = tgtadm {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.target_ip_address = 10.222.0.18 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.target_port   = 3260 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.357800 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.target_protocol = iscsi {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.trace_flags   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.unique_fqdn_network = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.use_chap_auth = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_backend_name = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.358600 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_clear  = zero {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_clear_ionice = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_clear_size = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.359423 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_reports.file_event_handler = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_reports.log_dir           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.backend_availability_zone = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.360241 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.backend_host              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361158 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.backend_native_threads_pool_size = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361299 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.driver [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Driver hasn't implemented _init_vendor_properties()
Apr 02 20:42:38.361449 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.backup_use_temp_snapshot  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.driver [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2301e769-c4fa-4abb-81c6-331d5b81bb60:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129783) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:811}}
Apr 02 20:42:38.361793 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.chap_password             = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361793 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.chap_username             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361793 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.chiscsi_conf              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.361793 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.deferred_deletion_delay   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.364291 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.deferred_deletion_purge_interval = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.364759 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_client_cert        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.365134 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_client_cert_key    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.365500 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_data_namespace     = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.366103 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_ssl_cert_path      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.366570 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_ssl_cert_verify    = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.367128 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.driver_use_ssl            = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.367850 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.enable_deferred_deletion  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.368739 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.enable_unsupported_driver = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.369181 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.369542 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.extra_capabilities        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.369900 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.filter_function           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.370258 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.goodness_function         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.370614 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iet_conf                  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.370973 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.image_upload_use_cinder_backend = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.371325 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.image_upload_use_internal_tenant = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.371703 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.image_volume_cache_enabled = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.372085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.image_volume_cache_max_count = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.372440 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.image_volume_cache_max_size_gb = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.372835 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iscsi_iotype              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.373199 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.373748 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iscsi_target_flags        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.374107 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iscsi_write_cache         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.374459 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iser_helper               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.374841 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iser_ip_address           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.375169 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iser_port                 = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.375517 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.iser_target_prefix        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.375870 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.max_over_subscription_ratio = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.376220 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.num_iser_scan_tries       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.376824 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.num_shell_tries           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.377486 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.num_volume_device_scan_tries = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.nvmet_ns_id               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.nvmet_port_id             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rados_connect_timeout     = -1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rados_connection_interval = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rados_connection_retries  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.380932 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.382210 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_cluster_name          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.382210 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.383194 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_db.sqlalchemy.engines [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Apr 02 20:42:38.383385 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.383385 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_max_clone_depth       = 5 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.383385 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_pool                  = volumes {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.384025 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_secret_uuid           = 5a58c21e-3129-49f4-b422-749ceba5f9c4 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.384419 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_store_chunk_size      = 4 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.384841 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.rbd_user                  = cinder {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.385202 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.replication_connect_timeout = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.385884 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.replication_device        = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.386599 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.report_discard_supported  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.387946 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.report_dynamic_total_capacity = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.389104 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.reserved_percentage       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.389104 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.scst_target_driver        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.389409 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.scst_target_iqn_name      = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.389627 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.storage_protocol          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.389985 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.suppress_requests_ssl_warnings = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.390596 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.target_helper             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.390750 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.target_ip_address         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.391528 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.target_port               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.391528 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.target_prefix             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.391895 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.target_protocol           = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.392054 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.trace_flags               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.392392 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.unique_fqdn_network       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.392843 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.use_chap_auth             = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.393197 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.use_multipath_for_image_xfer = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.393582 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_backend_name       = ceph {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.393958 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_clear              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.394363 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_clear_ionice       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.394662 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_clear_size         = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.395017 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.395661 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_copy_bps_limit     = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.396019 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_dd_blocksize       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.396497 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.396769 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ceph.volumes_dir               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.398472 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.398472 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.398812 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.399153 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.399727 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.400189 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.400605 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.400975 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.401347 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.401697 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.402085 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.402437 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.402829 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.403484 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.403858 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.404233 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.405609 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.409723 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.411127 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.412286 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.412703 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.413096 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.413537 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.ssl      = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.413931 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.414313 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.415330 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.416133 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.416538 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_notifications.driver = [] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.416944 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_notifications.retry = -1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.417378 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.417765 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] oslo_messaging_notifications.transport_url = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.418119 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.418433 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] key_manager.fixed_key          = **** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.418872 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.419296 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.barbican_api_version  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.419813 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.barbican_endpoint     = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.420259 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.barbican_endpoint_type = public {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.420662 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.barbican_region_name  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.421051 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.cafile                = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.421700 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.certfile              = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.422083 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.collect_timing        = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.422439 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.insecure              = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.422798 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.keyfile               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.423161 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.number_of_retries     = 60 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.423519 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.retry_delay           = 1 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.423876 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.send_service_user_token = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.424231 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.split_loggers         = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.424615 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.timeout               = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.424978 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.verify_ssl            = True {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.425075 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.db.sqlalchemy.api [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Building query based on filter {{(pid=129783) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3377}}
Apr 02 20:42:38.425334 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican.verify_ssl_path       = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.425709 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.auth_section = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.426064 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.auth_type = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.426586 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.cafile   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.427612 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.certfile = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.428309 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.collect_timing = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.428881 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.insecure = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.429406 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.keyfile  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.430266 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.split_loggers = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.430793 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] barbican_service_user.timeout  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.431537 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.approle_role_id          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.432058 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.approle_secret_id        = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.432606 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.cafile                   = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.433126 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.certfile                 = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.433645 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.collect_timing           = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.434278 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.insecure                 = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.434794 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.keyfile                  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.435317 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.kv_mountpoint            = secret {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.435822 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.kv_version               = 2 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.436334 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.namespace                = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.436886 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.root_token_id            = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.437413 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.split_loggers            = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.438424 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.ssl_ca_crt_file          = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.439092 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.timeout                  = None {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.439589 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.use_ssl                  = False {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.440253 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Apr 02 20:42:38.440710 ncdv-master-1 cinder-volume[129611]: DEBUG oslo_service.service [None req-5c5e4852-983e-4be1-99a6-87740459a86c None None] ******************************************************************************** {{(pid=129611) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Apr 02 20:42:38.445093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129783) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}}
Apr 02 20:42:38.452698 ncdv-master-1 cinder-volume[129783]: INFO cinder.keymgr.migration [None req-33a19e51-3b77-4510-8f59-8c6df977213b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 02 20:42:38.461024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.499264 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.551544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:42:38.590696 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Driver initialization completed successfully.
Apr 02 20:42:38.601322 ncdv-master-1 cinder-volume[129783]: INFO cinder.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Initiating service 3 cleanup
Apr 02 20:42:38.609137 ncdv-master-1 cinder-volume[129783]: INFO cinder.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Service 3 cleanup completed.
Apr 02 20:42:38.609475 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.service [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Creating RPC server for service cinder-volume {{(pid=129783) start /opt/stack/cinder/cinder/service.py:231}}
Apr 02 20:42:38.617517 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.service [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129783) start /opt/stack/cinder/cinder/service.py:237}}
Apr 02 20:42:38.694630 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Apr 02 20:42:38.696094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.728025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:42:38.782785 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4e6a4d0-93d2-4128-916f-bc7129752759 None None] Driver post RPC initialization completed successfully.
Apr 02 20:44:28.787238 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:44:28.788345 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:44:28.810114 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:44:28.833868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:45:28.792551 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:45:28.793223 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:45:28.816647 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:45:28.839331 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:46:28.794065 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:46:28.794763 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:46:28.816606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:46:28.837618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:47:28.792097 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:47:28.792820 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:47:28.819467 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:47:28.840914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:48:28.796759 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:48:28.797474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:48:28.820335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:48:28.842706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:49:28.797365 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:49:28.798085 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:49:28.818914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:49:28.846370 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:50:28.801879 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:50:28.802561 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:50:28.823632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:50:28.845052 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:51:28.805195 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:51:28.805861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:51:28.875726 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:51:28.962308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:52:28.805097 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:52:28.807257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:52:28.866789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:52:28.937093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:53:28.802292 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:53:28.803179 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:53:28.854729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:53:28.912320 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:54:28.798440 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:54:28.801303 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:54:28.928665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:54:29.013419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:54:33.415055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:54:33.555825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (7943f6a4-c507-449a-9b59-cf9ccf633fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:54:33.565824 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d640d14-cae2-49d8-a8b6-3a58d0d02f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:33.629422 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d640d14-cae2-49d8-a8b6-3a58d0d02f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-178703997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=df9cf386-bafd-4967-8b89-99831c61cab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e586602a4da4d659974e36ab71486a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:54:33Z,use_quota=True,user_id='a2e061bb9a054fb1945417baf444eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:33.635933 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37d37d-30c6-4b91-8200-658b9affb4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:33.646177 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37d37d-30c6-4b91-8200-658b9affb4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:33.661181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c9cfa-66f7-4e6d-a9de-1c1319a2e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:33.674899 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c9cfa-66f7-4e6d-a9de-1c1319a2e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9cf386-bafd-4967-8b89-99831c61cab1', 'volume_name': 'volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:33.686291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bc2b19-dab7-4b3e-aacf-475d7fd948a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:33.702111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bc2b19-dab7-4b3e-aacf-475d7fd948a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:33.713744 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9fdac5-e164-48fe-987c-47303c85dad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:33.719546 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Volume df9cf386-bafd-4967-8b89-99831c61cab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'volume_size': 1}
Apr 02 20:54:33.720266 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] creating volume 'volume-df9cf386-bafd-4967-8b89-99831c61cab1' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:54:33.723739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:54:34.172857 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:54:34.173444 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:54:34.178112 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9fdac5-e164-48fe-987c-47303c85dad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:34.188312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9e6b63-ad37-4b2f-9301-44a52c3320e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:54:34.220243 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Volume volume-df9cf386-bafd-4967-8b89-99831c61cab1 (df9cf386-bafd-4967-8b89-99831c61cab1): created successfully
Apr 02 20:54:34.224518 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9e6b63-ad37-4b2f-9301-44a52c3320e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:54:34.241729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (7943f6a4-c507-449a-9b59-cf9ccf633fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:54:34.310037 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-57f3076e-a30a-4fb4-a749-b244ed88cd4b tempest-LiveMigrationTest-896557035 None] Created volume successfully.
Apr 02 20:54:36.468682 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-260e0848-97d7-43a5-9175-4b9b2811037f req-299fcfaf-298b-453f-adb0-9b752cef80e0 tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:54:37.407441 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-260e0848-97d7-43a5-9175-4b9b2811037f req-299fcfaf-298b-453f-adb0-9b752cef80e0 tempest-LiveMigrationTest-896557035 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.937s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:54:37.411069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-260e0848-97d7-43a5-9175-4b9b2811037f req-299fcfaf-298b-453f-adb0-9b752cef80e0 tempest-LiveMigrationTest-896557035 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'df9cf386-bafd-4967-8b89-99831c61cab1', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:54:37.491635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-260e0848-97d7-43a5-9175-4b9b2811037f req-299fcfaf-298b-453f-adb0-9b752cef80e0 tempest-LiveMigrationTest-896557035 None] Connection info returned from driver {'name': 'volumes/volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df9cf386-bafd-4967-8b89-99831c61cab1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49f4747f-1f35-4f8b-a87d-a6a833e08e08'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:54:37.612402 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-260e0848-97d7-43a5-9175-4b9b2811037f req-299fcfaf-298b-453f-adb0-9b752cef80e0 tempest-LiveMigrationTest-896557035 None] attachment_update completed successfully.
Apr 02 20:54:44.423752 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-478b9e76-dd73-440e-b9a4-d4744d107e8c tempest-LiveMigrationTest-1623648684 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:54:45.273292 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-478b9e76-dd73-440e-b9a4-d4744d107e8c tempest-LiveMigrationTest-1623648684 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.849s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:54:45.274542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-478b9e76-dd73-440e-b9a4-d4744d107e8c tempest-LiveMigrationTest-1623648684 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'df9cf386-bafd-4967-8b89-99831c61cab1', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:54:45.303678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-478b9e76-dd73-440e-b9a4-d4744d107e8c tempest-LiveMigrationTest-1623648684 None] Connection info returned from driver {'name': 'volumes/volume-df9cf386-bafd-4967-8b89-99831c61cab1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'df9cf386-bafd-4967-8b89-99831c61cab1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '61125be3-eacb-4d52-8b2b-f4925d1b7faa'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:54:45.383296 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-478b9e76-dd73-440e-b9a4-d4744d107e8c tempest-LiveMigrationTest-1623648684 None] attachment_update completed successfully.
Apr 02 20:55:05.601787 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-b498ae9a-b664-4729-ba19-1999f7fac8a1 tempest-LiveMigrationTest-1623648684 None] Terminate volume connection completed successfully.
Apr 02 20:55:05.602437 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c1e7a6f4-b1d0-4463-9aa5-ccfbc4b259b0 req-b498ae9a-b664-4729-ba19-1999f7fac8a1 tempest-LiveMigrationTest-1623648684 None] Deleting attachment 49f4747f-1f35-4f8b-a87d-a6a833e08e08. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:55:26.315567 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-703a4ace-2669-4ace-9046-00d6904957b4 req-cf4f633f-1cb6-4ed1-894c-6c124fbc55e5 tempest-LiveMigrationTest-896557035 None] Terminate volume connection completed successfully.
Apr 02 20:55:26.316216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-703a4ace-2669-4ace-9046-00d6904957b4 req-cf4f633f-1cb6-4ed1-894c-6c124fbc55e5 tempest-LiveMigrationTest-896557035 None] Deleting attachment 61125be3-eacb-4d52-8b2b-f4925d1b7faa. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:55:28.151938 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:55:28.177255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (a90de471-4a70-4ff1-838b-9c5979db9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:55:28.200075 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c4239e-a805-4339-b86e-14d886de63de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:28.238473 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c4239e-a805-4339-b86e-14d886de63de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1831988875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2dc66bc6-7365-4044-a99a-86eb8a66d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e586602a4da4d659974e36ab71486a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:55:28Z,use_quota=True,user_id='a2e061bb9a054fb1945417baf444eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:28.244950 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4651b7-2815-41ac-b863-3b31d8d15969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:28.251326 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4651b7-2815-41ac-b863-3b31d8d15969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:28.259025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08605a62-bcf4-4f0f-8d0a-72cd74e80b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:28.398819 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08605a62-bcf4-4f0f-8d0a-72cd74e80b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'volume_name': 'volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2971272e0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:28.405398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e496aa35-587b-4eab-af18-7eafbc58ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:28.411628 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e496aa35-587b-4eab-af18-7eafbc58ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:28.417998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd8db66-15d7-40f7-a429-8c1dec212960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:28.419803 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume 2dc66bc6-7365-4044-a99a-86eb8a66d8c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2971272e0>}
Apr 02 20:55:28.420840 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Cloning 2dc66bc6-7365-4044-a99a-86eb8a66d8c3 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 20:55:28.434289 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:55:28.444785 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Preparing cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:879}}
Apr 02 20:55:28.446151 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 20:55:28.801915 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:55:28.802996 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:28.860982 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:28.919460 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:55:29.507182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:55:29.533069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Flow 'volume_create_manager' (f0bd19c4-86a6-428a-ac15-488e90f6f280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:55:29.542123 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cccaa80-8862-4e3f-b1e4-f9f3a16c5456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.569442 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cccaa80-8862-4e3f-b1e4-f9f3a16c5456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-98059501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0486766d-eba5-4c3f-99f9-c93a71bd86f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e2a80eb708d4a2b8aab54b268dc218d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:55:29Z,use_quota=True,user_id='cf5e0bd625644d9eabf92db0624219e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.576292 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a288d8-0036-4b66-9559-fe279c210d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.582360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a288d8-0036-4b66-9559-fe279c210d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.587854 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc8dff-c7ba-42c0-b1aa-148546792263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.608282 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2fc8dff-c7ba-42c0-b1aa-148546792263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'volume_name': 'volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.614029 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9619f1-8540-4c03-a415-fafe6f0a51f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.618351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9619f1-8540-4c03-a415-fafe6f0a51f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.623747 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfc8f91-2e1f-4165-aaf0-97d84b7982a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.624868 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Volume 0486766d-eba5-4c3f-99f9-c93a71bd86f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'volume_size': 1}
Apr 02 20:55:29.625285 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] creating volume 'volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:55:29.625965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:29.749146 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:55:29.750791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:55:29.762806 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfc8f91-2e1f-4165-aaf0-97d84b7982a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.774367 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161e3abf-930c-4e94-901f-7ac310a685ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:55:29.810964 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Volume volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3 (0486766d-eba5-4c3f-99f9-c93a71bd86f3): created successfully
Apr 02 20:55:29.827992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161e3abf-930c-4e94-901f-7ac310a685ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:55:29.834649 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Flow 'volume_create_manager' (f0bd19c4-86a6-428a-ac15-488e90f6f280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:55:29.850093 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-88839f2b-ee52-4d07-882c-760daa23260f tempest-AttachSCSIVolumeTestJSON-1933708698 None] Created volume successfully.
Apr 02 20:55:31.178603 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-7b276f39-88c8-4ca9-a687-dd912c5824c6 req-60284d1e-afa4-449d-8dbd-9c8317b356e5 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:32.000761 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-7b276f39-88c8-4ca9-a687-dd912c5824c6 req-60284d1e-afa4-449d-8dbd-9c8317b356e5 tempest-AttachSCSIVolumeTestJSON-1933708698 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.822s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:32.001541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-7b276f39-88c8-4ca9-a687-dd912c5824c6 req-60284d1e-afa4-449d-8dbd-9c8317b356e5 tempest-AttachSCSIVolumeTestJSON-1933708698 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:55:32.031781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-7b276f39-88c8-4ca9-a687-dd912c5824c6 req-60284d1e-afa4-449d-8dbd-9c8317b356e5 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Connection info returned from driver {'name': 'volumes/volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0486766d-eba5-4c3f-99f9-c93a71bd86f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2ed31592-f261-41cb-ba92-dfab4c491343'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:55:32.094848 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-7b276f39-88c8-4ca9-a687-dd912c5824c6 req-60284d1e-afa4-449d-8dbd-9c8317b356e5 tempest-AttachSCSIVolumeTestJSON-1933708698 None] attachment_update completed successfully.
Apr 02 20:55:35.535444 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8778b8ed-2dab-4a14-a0e9-346f13f43157 req-eb5dff63-f940-477e-80a2-41ce099f29ef tempest-AttachSCSIVolumeTestJSON-1933708698 None] Terminate volume connection completed successfully.
Apr 02 20:55:35.537286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8778b8ed-2dab-4a14-a0e9-346f13f43157 req-eb5dff63-f940-477e-80a2-41ce099f29ef tempest-AttachSCSIVolumeTestJSON-1933708698 None] Deleting attachment 2ed31592-f261-41cb-ba92-dfab4c491343. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:55:42.387127 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Lock "b'cinder-0486766d-eba5-4c3f-99f9-c93a71bd86f3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:55:42.433650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:42.538532 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:55:42.543997 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Volume volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:55:42.562910 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] deleting rbd volume volume-0486766d-eba5-4c3f-99f9-c93a71bd86f3 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:55:42.897800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph, size 616.00 MB, duration 14.44 sec {{(pid=129783) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}}
Apr 02 20:55:42.898212 ncdv-master-1 cinder-volume[129783]: INFO cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Image download 616.00 MB at 42.66 MB/s
Apr 02 20:55:42.959076 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:43.154529 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:55:43.155526 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:55:43.184575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Created reservations ['2f5baedc-91eb-48f3-8e58-6dac6e62e608', 'db4d43a0-74df-45b5-8e4f-504a752aedb8', '26587391-9fc3-4e68-a4bd-41aa2b1ecca8', '2c910261-7571-4261-a728-dc2f4d52b6cc'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:55:43.192023 ncdv-master-1 sudo[141064]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph
Apr 02 20:55:43.192978 ncdv-master-1 sudo[141064]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:43.260076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:43.323714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:43.377869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:55:43.388329 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Deleted volume successfully.
Apr 02 20:55:43.411227 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-207fb7f8-adf9-45a2-bc6c-db4def9ae7d2 tempest-AttachSCSIVolumeTestJSON-1933708698 None] Lock "b'cinder-0486766d-eba5-4c3f-99f9-c93a71bd86f3-delete_volume'" released by "delete_volume" :: held 1.024s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:55:44.745273 ncdv-master-1 sudo[141064]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:44.747023 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph" returned: 0 in 1.788s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:44.754418 ncdv-master-1 cinder-volume[129783]: WARNING py.warnings [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Apr 02 20:55:44.754418 ncdv-master-1 cinder-volume[129783]:   debtcollector.deprecate(
Apr 02 20:55:44.754418 ncdv-master-1 cinder-volume[129783]: 
Apr 02 20:55:44.755111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Temporary image 9e007d99-9b87-492c-9398-c1bd6aff27cb is fetched for user a2e061bb9a054fb1945417baf444eaee. {{(pid=129783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Apr 02 20:55:44.830508 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:44.990825 ncdv-master-1 sudo[141102]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph
Apr 02 20:55:44.991681 ncdv-master-1 sudo[141102]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:46.334262 ncdv-master-1 sudo[141102]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:46.336687 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph" returned: 0 in 1.506s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:46.339649 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] creating volume 'volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:55:46.342033 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:46.447616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:55:46.448003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:55:46.491592 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Attempting download of 9e007d99-9b87-492c-9398-c1bd6aff27cb ((None, None)) to volume 2dc66bc6-7365-4044-a99a-86eb8a66d8c3. {{(pid=129783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1178}}
Apr 02 20:55:46.548402 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_9e007d99-9b87-492c-9398-c1bd6aff27cb_2r_01dgm {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:46.665234 ncdv-master-1 sudo[141127]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_9e007d99-9b87-492c-9398-c1bd6aff27cb_2r_01dgm
Apr 02 20:55:46.673238 ncdv-master-1 sudo[141127]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:48.401357 ncdv-master-1 sudo[141127]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:48.404423 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_9e007d99-9b87-492c-9398-c1bd6aff27cb_2r_01dgm" returned: 0 in 1.856s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:48.405853 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:48.626798 ncdv-master-1 sudo[141158]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph
Apr 02 20:55:48.628371 ncdv-master-1 sudo[141158]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:50.513618 ncdv-master-1 sudo[141158]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:50.518277 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph" returned: 0 in 2.112s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:50.519846 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] 9e007d99-9b87-492c-9398-c1bd6aff27cb was vhdx, converting to raw {{(pid=129783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}}
Apr 02 20:55:50.520932 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp6d4c2ds7 {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:50.551038 ncdv-master-1 sudo[141191]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp6d4c2ds7
Apr 02 20:55:50.552290 ncdv-master-1 sudo[141191]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:53.242556 ncdv-master-1 sudo[141191]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:53.244937 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp6d4c2ds7" returned: 0 in 2.724s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:53.246044 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:55:53.417756 ncdv-master-1 sudo[141253]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph
Apr 02 20:55:53.418575 ncdv-master-1 sudo[141253]: pam_unix(sudo:session): session opened for user root by (uid=0)
Apr 02 20:55:54.629845 ncdv-master-1 sudo[141253]: pam_unix(sudo:session): session closed for user root
Apr 02 20:55:54.633025 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph" returned: 0 in 1.387s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:55:54.634699 ncdv-master-1 cinder-volume[129783]: WARNING py.warnings [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Apr 02 20:55:54.634699 ncdv-master-1 cinder-volume[129783]:   debtcollector.deprecate(
Apr 02 20:55:54.634699 ncdv-master-1 cinder-volume[129783]: 
Apr 02 20:55:54.635642 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9e007d99-9b87-492c-9398-c1bd6aff27cb_2uo_ddpnncdv-master-1@ceph, size 700.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/conversion/tmp6d4c2ds7 {{(pid=129783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}}
Apr 02 20:55:54.636325 ncdv-master-1 cinder-volume[129783]: INFO cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Converted 700.00 MB image at 256.88 MB/s
Apr 02 20:55:54.637976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:55:54.728749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:55:54.729201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:55:54.743363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] deleting rbd volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:55:55.133879 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp6d4c2ds7 volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:56:00.566551 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp6d4c2ds7 volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.432s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:56:00.814194 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:00.967905 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:56:00.969469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:56:00.970084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Downloaded image 9e007d99-9b87-492c-9398-c1bd6aff27cb ((None, None)) to volume 2dc66bc6-7365-4044-a99a-86eb8a66d8c3 successfully. {{(pid=129783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1218}}
Apr 02 20:56:01.054168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Temporary image 9e007d99-9b87-492c-9398-c1bd6aff27cb for user a2e061bb9a054fb1945417baf444eaee is deleted. {{(pid=129783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}}
Apr 02 20:56:01.159401 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Created reservations ['6d769791-0330-4152-84eb-c197fd224b72', '4f80b091-e98e-46fd-8e54-18795815b927', '468385e8-c57a-4abb-b671-8cc332071129', '05cabf01-c9ec-4234-9a00-7ab39fca0cb4'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:56:01.170858 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Creating image volume entry: {'created_at': datetime.datetime(2022, 4, 2, 20, 55, 28, tzinfo=datetime.timezone.utc), 'deleted': False, 'encryption_key_id': None, 'group_id': None, 'replication_status': None, 'user_id': 'a2e061bb9a054fb1945417baf444eaee', 'replication_extended_status': None, 'replication_driver_data': None, 'size': 1, 'provider_geometry': None, 'previous_status': None, 'service_uuid': None, 'multiattach': False, 'consistencygroup_id': None, 'host': 'ncdv-master-1@ceph#ceph', 'display_description': None, 'provider_id': None, 'volume_metadata': [], 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'bootable': False, 'ec2_id': None, 'launched_at': None, 'deleted_at': None, 'availability_zone': 'nova', 'shared_targets': True, 'project_id': 'dc74fe8a08da402d9cd82fd42d3f8f20', 'display_name': 'image-9e007d99-9b87-492c-9398-c1bd6aff27cb', 'cluster_name': None, 'provider_auth': None, 'updated_at': datetime.datetime(2022, 4, 2, 20, 55, 28, tzinfo=datetime.timezone.utc), 'volume_type_id': '4947600b-20cc-4146-8cbc-2a307b7d9583', 'provider_location': None, 'metadata': {}, 'volume_admin_metadata': [], 'scheduled_at': datetime.datetime(2022, 4, 2, 20, 55, 28, tzinfo=datetime.timezone.utc), 'terminated_at': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3'}. {{(pid=129783) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1614}}
Apr 02 20:56:01.244895 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume reschedule parameters: False retry: None {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:56:01.267066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (0c891079-b283-41bb-ae3e-1eb724a9e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:01.274609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923afa4e-ed6d-4bdd-8edd-7dfc2cc32c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:01.291250 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923afa4e-ed6d-4bdd-8edd-7dfc2cc32c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='image-9e007d99-9b87-492c-9398-c1bd6aff27cb',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=12737775-b8e0-4a5b-9746-c7d74b8b3bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc74fe8a08da402d9cd82fd42d3f8f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=2dc66bc6-7365-4044-a99a-86eb8a66d8c3,status='creating',terminated_at=None,updated_at=2022-04-02T20:55:28Z,use_quota=True,user_id='a2e061bb9a054fb1945417baf444eaee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:01.297984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb1acbf-a60f-4db1-b0a9-d377d79df919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:01.302027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb1acbf-a60f-4db1-b0a9-d377d79df919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:01.307097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333ad021-a4e0-4afb-9917-6a9cff8cba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:01.323132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333ad021-a4e0-4afb-9917-6a9cff8cba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'volume_name': 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'volume_size': 1, 'source_volid': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'source_volstatus': 'downloading'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:01.328907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f43187-fa88-4371-8a3a-cf5e7bdd86e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:01.344404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f43187-fa88-4371-8a3a-cf5e7bdd86e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:01.355096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76fce3e-1055-44dc-9ca1-bea4a348f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:01.356827 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'volume_size': 1, 'source_volid': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'source_volstatus': 'downloading'}
Apr 02 20:56:01.372200 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:01.445623 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] creating snapshot='volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 20:56:02.346575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] cloning 'volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3@volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb.clone_snap' to 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 20:56:02.485745 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:56:02.487267 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:56:02.488188 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:56:02.540397 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 20:56:02.543551 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c76fce3e-1055-44dc-9ca1-bea4a348f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'volume_size': 1, 'source_volid': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'source_volstatus': 'downloading'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:02.553693 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4418a02-8cc5-42b8-b4b8-af8c1bef4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:02.570062 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb (12737775-b8e0-4a5b-9746-c7d74b8b3bfb): created successfully
Apr 02 20:56:02.578308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4418a02-8cc5-42b8-b4b8-af8c1bef4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:02.595658 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (0c891079-b283-41bb-ae3e-1eb724a9e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:02.626682 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Created volume successfully.
Apr 02 20:56:02.715350 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Creating new image-volume cache entry for image 9e007d99-9b87-492c-9398-c1bd6aff27cb on ncdv-master-1@ceph#ceph {{(pid=129783) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Apr 02 20:56:02.735390 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] New image-volume cache entry created: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 20, 56, 2, 719264)}. {{(pid=129783) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Apr 02 20:56:02.750888 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 34.311s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:56:02.750888 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Marking volume 2dc66bc6-7365-4044-a99a-86eb8a66d8c3 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 20:56:02.770390 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 2dc66bc6-7365-4044-a99a-86eb8a66d8c3. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 20:56:02.771216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Creating volume glance metadata for volume 2dc66bc6-7365-4044-a99a-86eb8a66d8c3 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 20:56:02.974975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd8db66-15d7-40f7-a429-8c1dec212960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2971272e0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:02.985975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1788232-a96f-4b5e-a5e6-48502ea72589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:02.999969 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 (2dc66bc6-7365-4044-a99a-86eb8a66d8c3): created successfully
Apr 02 20:56:03.010210 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1788232-a96f-4b5e-a5e6-48502ea72589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:03.016072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Flow 'volume_create_manager' (a90de471-4a70-4ff1-838b-9c5979db9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:03.051473 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eeabf54c-c000-47ca-ac73-fc5c5bd68d1a tempest-LiveMigrationTest-896557035 None] Created volume successfully.
Apr 02 20:56:07.399888 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-00ec4306-ff36-4a4a-b4d5-06a951230c31 req-a2fa6978-f9ae-4a27-8f71-f1f41316fe36 tempest-LiveMigrationTest-896557035 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:56:08.775431 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-00ec4306-ff36-4a4a-b4d5-06a951230c31 req-a2fa6978-f9ae-4a27-8f71-f1f41316fe36 tempest-LiveMigrationTest-896557035 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.375s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:56:08.776254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-00ec4306-ff36-4a4a-b4d5-06a951230c31 req-a2fa6978-f9ae-4a27-8f71-f1f41316fe36 tempest-LiveMigrationTest-896557035 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:56:08.812997 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-00ec4306-ff36-4a4a-b4d5-06a951230c31 req-a2fa6978-f9ae-4a27-8f71-f1f41316fe36 tempest-LiveMigrationTest-896557035 None] Connection info returned from driver {'name': 'volumes/volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4119461a-4595-4831-b9dd-4b5e9bf2e8d5'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:56:08.909666 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-00ec4306-ff36-4a4a-b4d5-06a951230c31 req-a2fa6978-f9ae-4a27-8f71-f1f41316fe36 tempest-LiveMigrationTest-896557035 None] attachment_update completed successfully.
Apr 02 20:56:28.806323 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:56:28.809644 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:28.887843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:28.949596 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:56:29.330784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:56:29.358033 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Flow 'volume_create_manager' (4435ca4f-adfe-4132-8d30-39988d9042fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:29.368447 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a91e94-83c0-4bc7-b3e1-abcbb887fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.398247 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a91e94-83c0-4bc7-b3e1-abcbb887fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-335811377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e466f3c5-906c-4696-be9e-51f2c77cd2a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e28f04f7dd4777891efe100377f141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:56:29Z,use_quota=True,user_id='ee8c4a666eb94960b71b0353d32b5f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.403847 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00c48d3-7d31-4892-99ae-d96124f9fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.408258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00c48d3-7d31-4892-99ae-d96124f9fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.414323 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e46317f-874d-4089-ac7c-1f9c73917d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.418714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e46317f-874d-4089-ac7c-1f9c73917d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e466f3c5-906c-4696-be9e-51f2c77cd2a8', 'volume_name': 'volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.423933 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b156f0-12d9-4fd0-81ba-6da4ab503b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.428299 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5b156f0-12d9-4fd0-81ba-6da4ab503b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.433279 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb358b6-42ad-4876-8674-bd44e2c159c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.434708 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Volume e466f3c5-906c-4696-be9e-51f2c77cd2a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8', 'volume_size': 1}
Apr 02 20:56:29.435358 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] creating volume 'volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:56:29.436368 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:29.525582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:56:29.526970 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:56:29.532292 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb358b6-42ad-4876-8674-bd44e2c159c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.538062 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173111c0-a565-449b-b706-66a1008a392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:29.547987 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Volume volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8 (e466f3c5-906c-4696-be9e-51f2c77cd2a8): created successfully
Apr 02 20:56:29.552340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173111c0-a565-449b-b706-66a1008a392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:29.558279 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Flow 'volume_create_manager' (4435ca4f-adfe-4132-8d30-39988d9042fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:29.568226 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3e561bc4-6d3b-47af-9944-0b1de06fb902 tempest-ServersNegativeTestJSON-1054341429 None] Created volume successfully.
Apr 02 20:56:32.186502 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-1404a952-904a-430e-b7f3-2321b36db409 req-61e954bb-914e-4f94-8a93-659e8ce73505 tempest-LiveMigrationTest-1623648684 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:56:33.406177 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-1404a952-904a-430e-b7f3-2321b36db409 req-61e954bb-914e-4f94-8a93-659e8ce73505 tempest-LiveMigrationTest-1623648684 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.221s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:56:33.406979 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-1404a952-904a-430e-b7f3-2321b36db409 req-61e954bb-914e-4f94-8a93-659e8ce73505 tempest-LiveMigrationTest-1623648684 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:56:33.471030 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-1404a952-904a-430e-b7f3-2321b36db409 req-61e954bb-914e-4f94-8a93-659e8ce73505 tempest-LiveMigrationTest-1623648684 None] Connection info returned from driver {'name': 'volumes/volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2dc66bc6-7365-4044-a99a-86eb8a66d8c3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5352d47a-832e-471a-b0c4-d48108ed8a1c'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:56:33.615887 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-1404a952-904a-430e-b7f3-2321b36db409 req-61e954bb-914e-4f94-8a93-659e8ce73505 tempest-LiveMigrationTest-1623648684 None] attachment_update completed successfully.
Apr 02 20:56:33.664625 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:56:33.717695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Flow 'volume_create_manager' (8828ec03-97ba-4a75-94dc-4c091dd7a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:33.735503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906aaf8-bc28-424c-bf3d-dc40808d02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:33.770378 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906aaf8-bc28-424c-bf3d-dc40808d02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-209000234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e28f04f7dd4777891efe100377f141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:56:34Z,use_quota=True,user_id='ee8c4a666eb94960b71b0353d32b5f67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:33.784877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a81b312-0e90-4f8d-a474-491c6e2df98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:33.799568 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a81b312-0e90-4f8d-a474-491c6e2df98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:33.820568 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8be202-994a-4415-97c9-2b8dac07665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:33.825696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd8be202-994a-4415-97c9-2b8dac07665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c', 'volume_name': 'volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:33.830632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9799131-69ab-4291-a6a6-b7c8d2e3d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:33.847164 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9799131-69ab-4291-a6a6-b7c8d2e3d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:33.869917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03cae791-8dd9-41c1-916e-9b4c24ab2d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:33.874289 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Volume ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c', 'volume_size': 1}
Apr 02 20:56:33.874725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] creating volume 'volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:56:33.875563 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:56:34.032995 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:56:34.033722 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:56:34.039040 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03cae791-8dd9-41c1-916e-9b4c24ab2d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:34.053115 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56c6a12-984a-4e86-a4a3-1d023c79b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:56:34.070366 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Volume volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c (ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c): created successfully
Apr 02 20:56:34.074651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56c6a12-984a-4e86-a4a3-1d023c79b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:56:34.093920 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Flow 'volume_create_manager' (8828ec03-97ba-4a75-94dc-4c091dd7a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:56:34.105390 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8a9db538-7c0f-4c04-b2d2-c970812e97bb tempest-ServersNegativeTestJSON-1054341429 None] Created volume successfully.
Apr 02 20:56:43.108594 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-1404a952-904a-430e-b7f3-2321b36db409 req-a143d1d0-d2da-4b98-8e8b-b6da8aca2eb1 tempest-LiveMigrationTest-1623648684 None] Terminate volume connection completed successfully.
Apr 02 20:56:43.109728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-1404a952-904a-430e-b7f3-2321b36db409 req-a143d1d0-d2da-4b98-8e8b-b6da8aca2eb1 tempest-LiveMigrationTest-1623648684 None] Deleting attachment 4119461a-4595-4831-b9dd-4b5e9bf2e8d5. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:57:08.250996 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-ad16f2a5-eb05-4e42-800d-b6633ee6295b tempest-LiveMigrationTest-896557035 None] Terminate volume connection completed successfully.
Apr 02 20:57:08.251656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-ad16f2a5-eb05-4e42-800d-b6633ee6295b tempest-LiveMigrationTest-896557035 None] Deleting attachment 5352d47a-832e-471a-b0c4-d48108ed8a1c. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:57:08.431626 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-2dc66bc6-7365-4044-a99a-86eb8a66d8c3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:57:08.484571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:08.569154 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:57:08.569812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] volume has clone snapshot(s) {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1284}}
Apr 02 20:57:08.572355 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:57:08.763615 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Created reservations ['43e4acb4-e7cd-4599-ad92-c9445dce730d', 'adcc1d65-600d-497a-9ff3-2f8aab5cf137', 'e200b597-bd05-4505-8f8a-54ef2817b610', '29a43fb5-9d69-4179-aef2-61e78e54fc95'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:57:08.866288 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:08.919903 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:08.978686 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:57:08.987186 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Deleted volume successfully.
Apr 02 20:57:09.029173 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-5b4b218d-89a3-47f0-85f8-6f16d08c70dd req-bcb8639c-6e6d-4f6f-bea2-68c7fcf4c750 tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-2dc66bc6-7365-4044-a99a-86eb8a66d8c3-delete_volume'" released by "delete_volume" :: held 0.598s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:57:09.432443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-df9cf386-bafd-4967-8b89-99831c61cab1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:57:09.535822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:09.652400 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:57:09.653003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Volume volume-df9cf386-bafd-4967-8b89-99831c61cab1 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:57:09.664491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] deleting rbd volume volume-df9cf386-bafd-4967-8b89-99831c61cab1 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:57:10.037019 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Created reservations ['2a67e6ea-17cc-4b57-8ec6-d7c0efceab68', '9adfe74c-d3ed-42ad-87ae-1a0b4e048919', '14f01fba-7289-41b6-979b-abca09fb9a95', '2cbfdf31-852e-4f2b-ae91-6456efc0fa07'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:57:10.112687 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:10.152404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:10.219768 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:57:10.226075 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Deleted volume successfully.
Apr 02 20:57:10.250059 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-cc747c81-40de-4834-9248-5148a0eafe75 tempest-LiveMigrationTest-896557035 None] Lock "b'cinder-df9cf386-bafd-4967-8b89-99831c61cab1-delete_volume'" released by "delete_volume" :: held 0.818s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:57:28.806837 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:57:28.808919 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:28.886088 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:57:28.944394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:24.399592 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b3a97154-0d47-4b36-9bcb-8ec62e7ff21f tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-405747548: creating
Apr 02 20:58:24.485970 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b3a97154-0d47-4b36-9bcb-8ec62e7ff21f tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-405747548: created successfully
Apr 02 20:58:24.506561 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b3a97154-0d47-4b36-9bcb-8ec62e7ff21f tempest-GroupSnapshotsTest-335434035 None] Create group completed successfully.
Apr 02 20:58:26.139662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:58:26.190660 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (94a2377a-eeb1-4f6c-bff6-516eb1b8f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:26.200091 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9f0fec-1405-4458-b6ba-596d36e8ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.233514 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9f0fec-1405-4458-b6ba-596d36e8ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-721124293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=093d9aca-01fd-430d-85e7-45ed4e314c2d,host='ncdv-master-1@ceph#ceph',id=07b4d192-c42c-453a-93c1-e8034db58c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de7d95b2594f7f9ca0182d57ae454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:58:26Z,use_quota=True,user_id='feb6004edca04f8196301828a4967803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(734a5728-4dde-4efb-bf32-3d2f8f9705dc),volume_type_id=734a5728-4dde-4efb-bf32-3d2f8f9705dc)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.241721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed348a4-2afd-40ab-a4b8-81afe14f7f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.259118 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed348a4-2afd-40ab-a4b8-81afe14f7f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.270665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3101c5de-6d1f-42b7-b756-f1cc153f75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.275544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3101c5de-6d1f-42b7-b756-f1cc153f75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07b4d192-c42c-453a-93c1-e8034db58c7d', 'volume_name': 'volume-07b4d192-c42c-453a-93c1-e8034db58c7d', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.283076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca26adad-41e2-46b0-913f-306de99a9713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.288408 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca26adad-41e2-46b0-913f-306de99a9713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.294622 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224b9be-7f6c-4c54-a272-d6f9d79f4638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.295815 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Volume 07b4d192-c42c-453a-93c1-e8034db58c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07b4d192-c42c-453a-93c1-e8034db58c7d', 'volume_size': 1}
Apr 02 20:58:26.296220 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] creating volume 'volume-07b4d192-c42c-453a-93c1-e8034db58c7d' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:58:26.297064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:26.450214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:58:26.450846 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:58:26.454879 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224b9be-7f6c-4c54-a272-d6f9d79f4638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b4d192-c42c-453a-93c1-e8034db58c7d', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.465076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a5bd90-9a5e-47d2-a97d-b8b1901bb920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:26.480437 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Volume volume-07b4d192-c42c-453a-93c1-e8034db58c7d (07b4d192-c42c-453a-93c1-e8034db58c7d): created successfully
Apr 02 20:58:26.489586 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a5bd90-9a5e-47d2-a97d-b8b1901bb920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:26.496776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (94a2377a-eeb1-4f6c-bff6-516eb1b8f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:26.511610 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9be347e5-b491-43d1-81a1-0de224d5ebaf tempest-GroupSnapshotsTest-335434035 None] Created volume successfully.
Apr 02 20:58:27.581329 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f27deb8c-6405-4e12-91e4-ec4af66422b8 tempest-GroupSnapshotsTest-335434035 None] GroupSnapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: creating.
Apr 02 20:58:27.680226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f27deb8c-6405-4e12-91e4-ec4af66422b8 tempest-GroupSnapshotsTest-335434035 None] Group snapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: creating. {{(pid=129783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 02 20:58:27.726443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f27deb8c-6405-4e12-91e4-ec4af66422b8 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:28.493285 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f27deb8c-6405-4e12-91e4-ec4af66422b8 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: created successfully
Apr 02 20:58:28.803921 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:58:28.804868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:28.870263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:28.944564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:29.580113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] cloning volumes/volume-07b4d192-c42c-453a-93c1-e8034db58c7d@snapshot-ed06e4bd-65b2-48b3-bedc-5d5e080dcb6b to volume-31eb86c3-3267-4d9c-9e4a-ccd5fdc10eca {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 20:58:29.588869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:29.692734 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:29.904368 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:58:29.905022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:58:29.909541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:29.962707 ncdv-master-1 cinder-volume[129783]: WARNING cinder.volume.drivers.rbd [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError
Apr 02 20:58:30.066373 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-943ec1f8-f1eb-4fde-9914-6f136f8e5fbf tempest-GroupSnapshotsTest-335434035 None] Create group from source-snapshot-0864c7fb-63ef-4631-b681-2d1a7c9d846d completed successfully.
Apr 02 20:58:31.263073 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:31.365261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:31.373606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] deleting rbd volume volume-31eb86c3-3267-4d9c-9e4a-ccd5fdc10eca {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:31.722744 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['c6de4943-1273-4250-afc1-7db0fdce7538'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:31.750544 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2141409068 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2141409068, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:31.751368 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2141409068 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2141409068, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:31.771948 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['01d5b302-af40-4086-bf4a-0037cbf7e5fa', '07d0b8f3-179b-4409-8ddc-b2b4db626692', '17f5dba5-a895-47b6-b977-dd2ed407bd4b', '63577824-3e96-44f1-b96b-b4ae1e122cfa'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:31.869526 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:31.937735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:31.996599 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:32.006988 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d6cc3463-2359-4cbf-9e66-768e8362f001 tempest-GroupSnapshotsTest-335434035 None] Delete group completed successfully.
Apr 02 20:58:32.528940 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: deleting
Apr 02 20:58:32.551238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: deleting {{(pid=129783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 02 20:58:32.572878 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:33.489708 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2141409068 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2141409068, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:33.514316 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['fd2e4bd8-5be8-4217-8860-e20268e154e5', 'c035780a-77fa-4035-9b56-3219ba627d62', 'b64e07dd-165b-4e47-aa8e-f46739945666', 'ea8f16a9-d322-4eed-b3ab-d2924945a59b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:33.577817 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2d7df9d6-acc2-4abd-adc0-05686322ab23 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 0864c7fb-63ef-4631-b681-2d1a7c9d846d: deleted successfully
Apr 02 20:58:34.094338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:34.190875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:34.191542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Volume volume-07b4d192-c42c-453a-93c1-e8034db58c7d is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:34.205684 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] deleting rbd volume volume-07b4d192-c42c-453a-93c1-e8034db58c7d {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:34.628903 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['de120223-5470-4f65-bc94-cacfd6439c30'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:34.662084 ncdv-master-1 cinder-volume[129783]: WARNING cinder.db.sqlalchemy.api [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2141409068']
Apr 02 20:58:34.666166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['67b9af81-6e08-421a-b9d6-0f5f71159347', '4f51576f-37f6-43a2-be97-3cfab68cff8c', '6151e2c0-cfa2-4fc2-b80b-a3fbfd8b4253', 'c7342dd2-862c-4afa-bd1b-9f6d3a00afea'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:34.776751 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:34.820571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:34.870106 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:34.873977 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73da94a0-0dae-4481-9868-f1e6fcf64d99 tempest-GroupSnapshotsTest-335434035 None] Delete group completed successfully.
Apr 02 20:58:35.599167 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f9358749-d8c1-4160-bef7-daa458019406 tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-1145041908: creating
Apr 02 20:58:35.629113 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f9358749-d8c1-4160-bef7-daa458019406 tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-1145041908: created successfully
Apr 02 20:58:35.648181 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f9358749-d8c1-4160-bef7-daa458019406 tempest-GroupSnapshotsTest-335434035 None] Create group completed successfully.
Apr 02 20:58:37.195863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:58:37.269631 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (9dc27746-b4a0-4820-8d7f-3ba075095cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:37.277505 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0b2768-7e1a-4dce-a4d2-b25e2654d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.303332 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0b2768-7e1a-4dce-a4d2-b25e2654d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2123909300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3cbff1ae-738a-462e-903c-4d42468ab1f5,host='ncdv-master-1@ceph#ceph',id=b8b11d78-b765-4c57-84d8-e92fa7e8dfdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de7d95b2594f7f9ca0182d57ae454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:58:37Z,use_quota=True,user_id='feb6004edca04f8196301828a4967803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f314149-7bff-4382-a2da-6d4d3f6007cd),volume_type_id=4f314149-7bff-4382-a2da-6d4d3f6007cd)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.310905 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75041b4e-efe7-48a7-9fe8-9af4d8f8899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.318731 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75041b4e-efe7-48a7-9fe8-9af4d8f8899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.345622 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2c778d-730a-4c08-889f-71b0b2e361c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.356784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2c778d-730a-4c08-889f-71b0b2e361c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b11d78-b765-4c57-84d8-e92fa7e8dfdb', 'volume_name': 'volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.362738 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb4c546-4e4d-461f-a239-ece072926c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.367037 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb4c546-4e4d-461f-a239-ece072926c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.371826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3385cfd-4741-4035-abdf-ef45de44f09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.373193 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Volume b8b11d78-b765-4c57-84d8-e92fa7e8dfdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb', 'volume_size': 1}
Apr 02 20:58:37.373650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] creating volume 'volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:58:37.374530 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:37.456480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:58:37.456686 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:58:37.460833 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3385cfd-4741-4035-abdf-ef45de44f09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.466030 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940062ce-03b2-48e5-96cf-504615b6fae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:37.488653 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Volume volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb (b8b11d78-b765-4c57-84d8-e92fa7e8dfdb): created successfully
Apr 02 20:58:37.493032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940062ce-03b2-48e5-96cf-504615b6fae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:37.498828 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (9dc27746-b4a0-4820-8d7f-3ba075095cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:37.509309 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c1bff6e7-0614-418f-8d56-161336b37120 tempest-GroupSnapshotsTest-335434035 None] Created volume successfully.
Apr 02 20:58:38.796821 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:58:38.817850 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (a4fa4d3f-ea2f-4b87-9c8c-c18f068a1275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:38.825060 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22192fae-f3e5-49bc-b014-a5f39eba340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.842534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22192fae-f3e5-49bc-b014-a5f39eba340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1568487344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3cbff1ae-738a-462e-903c-4d42468ab1f5,host='ncdv-master-1@ceph#ceph',id=2968549c-5684-4fb2-b7c6-02fab3467c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de7d95b2594f7f9ca0182d57ae454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:58:39Z,use_quota=True,user_id='feb6004edca04f8196301828a4967803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f314149-7bff-4382-a2da-6d4d3f6007cd),volume_type_id=4f314149-7bff-4382-a2da-6d4d3f6007cd)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.849022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080a297-9e4f-42a7-b06b-50382598edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.853261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7080a297-9e4f-42a7-b06b-50382598edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.858461 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bc1d99-5137-4050-9621-805b73413f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.862632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bc1d99-5137-4050-9621-805b73413f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2968549c-5684-4fb2-b7c6-02fab3467c1b', 'volume_name': 'volume-2968549c-5684-4fb2-b7c6-02fab3467c1b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.867764 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107ac205-3b70-433a-9a42-174f013e2fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.871857 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107ac205-3b70-433a-9a42-174f013e2fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.876776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f99b15-1a82-4fc5-ae58-87ff5de7acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.878003 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Volume 2968549c-5684-4fb2-b7c6-02fab3467c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2968549c-5684-4fb2-b7c6-02fab3467c1b', 'volume_size': 1}
Apr 02 20:58:38.878493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] creating volume 'volume-2968549c-5684-4fb2-b7c6-02fab3467c1b' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:58:38.879281 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:38.960095 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:58:38.960606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:58:38.964789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f99b15-1a82-4fc5-ae58-87ff5de7acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2968549c-5684-4fb2-b7c6-02fab3467c1b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.969703 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca41832-3aba-4b9c-85e0-e0bac3d4bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:38.983894 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Volume volume-2968549c-5684-4fb2-b7c6-02fab3467c1b (2968549c-5684-4fb2-b7c6-02fab3467c1b): created successfully
Apr 02 20:58:38.987942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca41832-3aba-4b9c-85e0-e0bac3d4bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:38.994008 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (a4fa4d3f-ea2f-4b87-9c8c-c18f068a1275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:39.008069 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-76e4f310-c867-4543-9cfb-ed6f1a4496d7 tempest-GroupSnapshotsTest-335434035 None] Created volume successfully.
Apr 02 20:58:40.002297 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7dae87e8-9471-42e2-abc8-13c8463fccec tempest-GroupSnapshotsTest-335434035 None] Update group completed successfully.
Apr 02 20:58:41.168939 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8b9830ac-c07e-49d2-be70-e2505a4bf51d tempest-GroupSnapshotsTest-335434035 None] Update group completed successfully.
Apr 02 20:58:42.279405 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-827d3fc3-c967-40b3-8df1-9b3989bdbb03 tempest-GroupSnapshotsTest-335434035 None] Update group completed successfully.
Apr 02 20:58:42.673777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Lock "b'cinder-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:58:42.704220 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:42.748610 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:42.749746 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Volume volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:42.755555 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] deleting rbd volume volume-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:42.985565 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Created reservations ['01641cac-1718-4474-90cb-7a2b8e5172c4', 'c6044884-63fe-468b-8415-a723338f0c8d', 'd367a2fe-8845-426b-a7cc-226684e4df3c', '946894a0-ad6a-4580-944c-0cca4af5fec8'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:43.029174 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:43.055325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:43.079246 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:43.085196 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Deleted volume successfully.
Apr 02 20:58:43.100178 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ad9b5f49-28a8-476c-8a00-3313be83ab62 tempest-ServersNegativeTestJSON-1054341429 None] Lock "b'cinder-ccf55d4d-bb06-4e3f-98f4-fd2517d6fd0c-delete_volume'" released by "delete_volume" :: held 0.426s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:58:43.415235 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-37ee14b3-f1e2-4a20-904a-cfb7bbe023cd tempest-GroupSnapshotsTest-335434035 None] Update group completed successfully.
Apr 02 20:58:43.796600 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Lock "b'cinder-e466f3c5-906c-4696-be9e-51f2c77cd2a8-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:58:43.831603 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:43.868848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:43.869294 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Volume volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:43.875848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] deleting rbd volume volume-e466f3c5-906c-4696-be9e-51f2c77cd2a8 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:44.110025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Created reservations ['609c1ccb-91c0-41f4-9a60-e224f1c7afad', 'fd6aa5a7-5685-4681-b026-21f14a0f5ff3', '13282480-0d9c-4c8d-a3b3-c82e478c8862', '8201025f-8b38-49b4-b117-11a384587d6b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:44.165607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:44.202968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:44.232507 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:44.236672 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Deleted volume successfully.
Apr 02 20:58:44.249664 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-67013785-85e7-4659-8a69-d939e1a95d18 tempest-ServersNegativeTestJSON-1054341429 None] Lock "b'cinder-e466f3c5-906c-4696-be9e-51f2c77cd2a8-delete_volume'" released by "delete_volume" :: held 0.453s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:58:44.713512 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c61a9944-ed8b-4aba-b06c-ba20b653d028 tempest-GroupSnapshotsTest-335434035 None] GroupSnapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: creating.
Apr 02 20:58:44.734760 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c61a9944-ed8b-4aba-b06c-ba20b653d028 tempest-GroupSnapshotsTest-335434035 None] Group snapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: creating. {{(pid=129783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 02 20:58:44.751351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c61a9944-ed8b-4aba-b06c-ba20b653d028 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:45.297556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c61a9944-ed8b-4aba-b06c-ba20b653d028 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:46.377570 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c61a9944-ed8b-4aba-b06c-ba20b653d028 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: created successfully
Apr 02 20:58:46.944553 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: deleting
Apr 02 20:58:46.962144 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: deleting {{(pid=129783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 02 20:58:46.985904 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:48.222395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:49.381818 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2114306508 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2114306508, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:49.383382 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2114306508 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2114306508, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:49.408431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['c80f0c7b-34cf-408f-b7fa-ab549aa1c73c', 'e69a2cee-ad3b-46d1-bd18-931240db4224', '168be24e-0650-41ba-b09b-39f5fa498028', '972887e0-72af-4d7f-a711-3ca58726d5d5'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:49.527008 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] Created reservations ['2e19a5d3-d5dc-4396-befb-ef6ef6890acf', '7f1d2551-17b6-4bc2-a172-e9b407e40c39', '62ba72dd-fe7d-4d79-b95b-201b69e86aa9', 'ec8d5e6e-dad2-475d-9155-5939419d52c9'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:49.595848 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-42928174-9dab-46ce-b13c-0a9b94998cc8 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 2454b562-4fc4-4ef9-a83c-b79786068de4: deleted successfully
Apr 02 20:58:51.109874 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:51.190121 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:51.191238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Volume volume-2968549c-5684-4fb2-b7c6-02fab3467c1b is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:51.199991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] deleting rbd volume volume-2968549c-5684-4fb2-b7c6-02fab3467c1b {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:51.556996 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:51.618988 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:51.619419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Volume volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:51.633161 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] deleting rbd volume volume-b8b11d78-b765-4c57-84d8-e92fa7e8dfdb {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:58:52.078292 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Created reservations ['35d9d339-f34d-46ac-a1ae-ce8324fcd472'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:52.110343 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2114306508 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2114306508, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:52.126631 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Created reservations ['6509ea2c-3bc1-4a36-acba-b1e0c22501c2', 'c3bc1bca-16b9-4e4a-b50c-291513237e10', '63467735-edd4-46b9-b016-808d46929e62', '67c2b29b-ce7d-4384-adbb-7b94923d6ff8'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:52.276081 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Created reservations ['d4cc4c3b-9a8f-4aa9-b7cd-cef6dedd2c28', '6fe72d06-cec5-4972-b311-f621f3b95ef9', 'c7f8a654-5873-4a85-a70e-68c7bdf593e5', '473f2c24-c406-4ba6-ac6c-6a63bd0add8e'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:52.430438 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:52.499627 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:52.585046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:58:52.595464 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e5b74061-97d1-4aaa-ba01-7306f7a6112c tempest-GroupSnapshotsTest-335434035 None] Delete group completed successfully.
Apr 02 20:58:53.743236 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7e220785-2bdb-4de2-865a-32b7f74a133d tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-1033323564: creating
Apr 02 20:58:53.761980 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7e220785-2bdb-4de2-865a-32b7f74a133d tempest-GroupSnapshotsTest-335434035 None] Group tempest-GroupSnapshotsTest-Group-1033323564: created successfully
Apr 02 20:58:53.788856 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7e220785-2bdb-4de2-865a-32b7f74a133d tempest-GroupSnapshotsTest-335434035 None] Create group completed successfully.
Apr 02 20:58:55.288380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:58:55.312050 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (7e1a6bc0-ae04-4eb4-8f82-1b21d73d1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:55.318715 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd25e27-6aa5-4eca-9cf8-8e5ae0d091af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.335209 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd25e27-6aa5-4eca-9cf8-8e5ae0d091af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-553103574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=db4f7285-bc09-4e55-b5e1-4fbfe8a32097,host='ncdv-master-1@ceph#ceph',id=90b70ec5-d6d0-4d8a-b865-3f8e74070822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94de7d95b2594f7f9ca0182d57ae454a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:58:55Z,use_quota=True,user_id='feb6004edca04f8196301828a4967803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b8f9898-bd25-4034-9318-0fbaac25e636),volume_type_id=2b8f9898-bd25-4034-9318-0fbaac25e636)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.340904 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119b490a-876c-4104-9952-c0c476b0f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.345553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119b490a-876c-4104-9952-c0c476b0f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.351445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52eb588-7da7-4778-8379-333f1f495573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.356265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52eb588-7da7-4778-8379-333f1f495573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b70ec5-d6d0-4d8a-b865-3f8e74070822', 'volume_name': 'volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.361483 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1429c54e-db4a-4ac2-9527-8ba5cfc352e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.366046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1429c54e-db4a-4ac2-9527-8ba5cfc352e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.371094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92cf92b-99dd-4e14-a74f-9e5a71e6edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.372268 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Volume 90b70ec5-d6d0-4d8a-b865-3f8e74070822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822', 'volume_size': 1}
Apr 02 20:58:55.372899 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] creating volume 'volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:58:55.373707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:55.468062 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:58:55.469153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:58:55.473238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92cf92b-99dd-4e14-a74f-9e5a71e6edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.478412 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a6c5f-d976-4546-85a2-57af05610caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:58:55.493726 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Volume volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822 (90b70ec5-d6d0-4d8a-b865-3f8e74070822): created successfully
Apr 02 20:58:55.497910 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d6a6c5f-d976-4546-85a2-57af05610caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:58:55.504708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Flow 'volume_create_manager' (7e1a6bc0-ae04-4eb4-8f82-1b21d73d1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:58:55.515218 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-80a66fc2-be5a-4cb9-a044-c4e1db83d099 tempest-GroupSnapshotsTest-335434035 None] Created volume successfully.
Apr 02 20:58:56.513803 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-13f45c38-35f8-44e8-9bc1-8261513cbb18 tempest-GroupSnapshotsTest-335434035 None] GroupSnapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: creating.
Apr 02 20:58:56.539893 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-13f45c38-35f8-44e8-9bc1-8261513cbb18 tempest-GroupSnapshotsTest-335434035 None] Group snapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: creating. {{(pid=129783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 02 20:58:56.560926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-13f45c38-35f8-44e8-9bc1-8261513cbb18 tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:56.793836 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-13f45c38-35f8-44e8-9bc1-8261513cbb18 tempest-GroupSnapshotsTest-335434035 None] group_snapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: created successfully
Apr 02 20:58:57.796954 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] group_snapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: deleting
Apr 02 20:58:57.816847 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] group_snapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: deleting {{(pid=129783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 02 20:58:57.839314 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:58.796646 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1275564350 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1275564350, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:58.797823 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1275564350 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1275564350, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:58:58.816366 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] Created reservations ['1e11094b-26cd-44b8-91ef-1ea0d0047c27', 'd811f02d-e1e3-4a3e-ac5e-6bbf4f554e21', '3d450e31-8f11-4035-a5ba-dac4012b452b', '1170d3b7-e553-4c6f-b584-cfc79eb9001b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:58:58.869895 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8a98b77d-7619-430b-be39-d45fcca46dec tempest-GroupSnapshotsTest-335434035 None] group_snapshot 62aab68b-963b-44a6-af1f-af35e7ce7d93: deleted successfully
Apr 02 20:58:59.637063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:58:59.761113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:58:59.761575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Volume volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:58:59.781724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] deleting rbd volume volume-90b70ec5-d6d0-4d8a-b865-3f8e74070822 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:59:00.223597 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Created reservations ['baee3d08-9977-4b9a-b807-821567d9377c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:00.254391 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1275564350 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1275564350, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:59:00.298220 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Created reservations ['573a7c80-c659-4650-89ca-0a08e7a8c9c6', 'b5bb1f2e-6fc9-4ae4-a273-c1d912499c1c', '346acfc6-1108-42bb-b6ee-747673aa9ea5', '3d49feaa-90fb-48e8-8323-f2ec84dee8dd'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:00.450668 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:00.529679 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:00.581580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:00.588577 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-44cb7a88-4b2d-4d6c-b296-8e18d5415e5f tempest-GroupSnapshotsTest-335434035 None] Delete group completed successfully.
Apr 02 20:59:05.390029 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:59:05.446853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Flow 'volume_create_manager' (62dfec16-51d6-4b8d-8e22-be6bcac5f037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:05.458217 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229f5cc1-63ca-4cac-8d57-bc0fd7468d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.476262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229f5cc1-63ca-4cac-8d57-bc0fd7468d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1486638204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce1d6038-17a9-4e87-9091-bac12977e2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a3f8d3d3e94b31ab9aa73d8905b12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:59:05Z,use_quota=True,user_id='4eaee1ddad0041828fb2e65677e2da25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.483290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42851173-4d97-40bc-8610-e5c3a6d3126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.489392 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42851173-4d97-40bc-8610-e5c3a6d3126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.495485 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d64e63-3eed-4bed-979f-7e3a45a668b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.500258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d64e63-3eed-4bed-979f-7e3a45a668b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1d6038-17a9-4e87-9091-bac12977e2a7', 'volume_name': 'volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.507467 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00b1de7-78ac-406b-abcb-824c8c183411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.513053 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00b1de7-78ac-406b-abcb-824c8c183411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.520836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df54a049-90b5-44d7-854a-bba69ff9e15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.522410 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume ce1d6038-17a9-4e87-9091-bac12977e2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'volume_size': 1}
Apr 02 20:59:05.523265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] creating volume 'volume-ce1d6038-17a9-4e87-9091-bac12977e2a7' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:59:05.524787 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:05.645136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:59:05.645793 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:59:05.650057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df54a049-90b5-44d7-854a-bba69ff9e15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.658614 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3647a-78e8-44f8-a06b-fa8fc28dd77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:05.680489 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume volume-ce1d6038-17a9-4e87-9091-bac12977e2a7 (ce1d6038-17a9-4e87-9091-bac12977e2a7): created successfully
Apr 02 20:59:05.687573 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c3647a-78e8-44f8-a06b-fa8fc28dd77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:05.723589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Flow 'volume_create_manager' (62dfec16-51d6-4b8d-8e22-be6bcac5f037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:05.741242 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f4fc2a1b-a170-4680-bf64-a6c912611bd6 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Created volume successfully.
Apr 02 20:59:07.364967 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-71cb7978-eeef-40e0-a326-4a5280d5d404 req-21083db0-823d-4c4c-bc30-75bbdb1f0159 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:59:08.660151 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-71cb7978-eeef-40e0-a326-4a5280d5d404 req-21083db0-823d-4c4c-bc30-75bbdb1f0159 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.294s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:59:08.662074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-71cb7978-eeef-40e0-a326-4a5280d5d404 req-21083db0-823d-4c4c-bc30-75bbdb1f0159 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'ce1d6038-17a9-4e87-9091-bac12977e2a7', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:59:08.724392 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-71cb7978-eeef-40e0-a326-4a5280d5d404 req-21083db0-823d-4c4c-bc30-75bbdb1f0159 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Connection info returned from driver {'name': 'volumes/volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce1d6038-17a9-4e87-9091-bac12977e2a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd08df4f9-99ac-4e4a-9e86-ea7f13b3a808'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:59:08.796672 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-71cb7978-eeef-40e0-a326-4a5280d5d404 req-21083db0-823d-4c4c-bc30-75bbdb1f0159 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] attachment_update completed successfully.
Apr 02 20:59:15.334043 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-26984491-24ab-4c79-8d37-78a3e1409553 tempest-GroupsV314Test-202833462 None] Group tempest-GroupsV314Test-Group-1135648876: creating
Apr 02 20:59:15.356678 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-26984491-24ab-4c79-8d37-78a3e1409553 tempest-GroupsV314Test-202833462 None] Group tempest-GroupsV314Test-Group-1135648876: created successfully
Apr 02 20:59:15.387087 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-26984491-24ab-4c79-8d37-78a3e1409553 tempest-GroupsV314Test-202833462 None] Create group completed successfully.
Apr 02 20:59:16.406088 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-edd52884-b632-498b-aad6-103d7eed2bb9 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 20:59:17.207677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:59:17.267385 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Flow 'volume_create_manager' (fda2a843-99af-4f40-a6ca-0b725328fb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:17.291270 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98199e8-3f2e-4c3a-b2fd-733c96b8cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.345311 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c98199e8-3f2e-4c3a-b2fd-733c96b8cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1467967694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=82034c4b-c190-494e-a320-9af6e1e19434,host='ncdv-master-1@ceph#ceph',id=63e3a329-891c-4536-82af-31304434f89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233e3f51218646e7a0367c7aafe69ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:59:17Z,use_quota=True,user_id='4b345f30a4a241cf92dade0e761057fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ec537b6-acd1-4ac6-926c-172fd8b43b4b),volume_type_id=5ec537b6-acd1-4ac6-926c-172fd8b43b4b)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.359869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c31dd8b-7ad9-4484-a743-b15430cc9b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.371371 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c31dd8b-7ad9-4484-a743-b15430cc9b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.390680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac85da01-0a26-41f2-aff5-9520994b5c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.399046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac85da01-0a26-41f2-aff5-9520994b5c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e3a329-891c-4536-82af-31304434f89c', 'volume_name': 'volume-63e3a329-891c-4536-82af-31304434f89c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.411793 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3101c2a-f3b9-43b2-aacc-1a7cb75e69f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.428132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3101c2a-f3b9-43b2-aacc-1a7cb75e69f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.448399 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2704dad2-303f-49cf-93e2-7fbcc768e242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.457598 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Volume 63e3a329-891c-4536-82af-31304434f89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e3a329-891c-4536-82af-31304434f89c', 'volume_size': 1}
Apr 02 20:59:17.457978 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] creating volume 'volume-63e3a329-891c-4536-82af-31304434f89c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:59:17.462392 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:17.609571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:59:17.610650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:59:17.615375 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2704dad2-303f-49cf-93e2-7fbcc768e242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e3a329-891c-4536-82af-31304434f89c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.622529 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c80cd6-c439-4a4b-a1ed-0070282f030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:17.660267 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Volume volume-63e3a329-891c-4536-82af-31304434f89c (63e3a329-891c-4536-82af-31304434f89c): created successfully
Apr 02 20:59:17.664520 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c80cd6-c439-4a4b-a1ed-0070282f030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:17.670668 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Flow 'volume_create_manager' (fda2a843-99af-4f40-a6ca-0b725328fb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:17.702967 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f34f3ede-b68d-4b0a-8337-73df9d537d0d tempest-GroupsV314Test-202833462 None] Created volume successfully.
Apr 02 20:59:18.233363 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-edd52884-b632-498b-aad6-103d7eed2bb9 tempest-LiveAutoBlockMigrationV225Test-253478136 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.827s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 20:59:18.234898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-edd52884-b632-498b-aad6-103d7eed2bb9 tempest-LiveAutoBlockMigrationV225Test-253478136 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'ce1d6038-17a9-4e87-9091-bac12977e2a7', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 20:59:18.285242 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-edd52884-b632-498b-aad6-103d7eed2bb9 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Connection info returned from driver {'name': 'volumes/volume-ce1d6038-17a9-4e87-9091-bac12977e2a7', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce1d6038-17a9-4e87-9091-bac12977e2a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a2576e3f-26d6-431c-a8f5-0af21b9d1494'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 20:59:18.471103 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-edd52884-b632-498b-aad6-103d7eed2bb9 tempest-LiveAutoBlockMigrationV225Test-253478136 None] attachment_update completed successfully.
Apr 02 20:59:19.205200 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:19.299183 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] creating snapshot='volume-1080a362-d941-4645-87f5-4bcb1c485cd7.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 20:59:20.400299 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] cloning 'volume-63e3a329-891c-4536-82af-31304434f89c@volume-1080a362-d941-4645-87f5-4bcb1c485cd7.clone_snap' to 'volume-1080a362-d941-4645-87f5-4bcb1c485cd7' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 20:59:20.570140 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] Volume volume-63e3a329-891c-4536-82af-31304434f89c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:59:20.575295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:59:20.575946 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:59:20.625262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 20:59:20.762598 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b7c0e6a6-b12c-431a-a93f-2771cdf2e68e tempest-GroupsV314Test-202833462 None] Create group from source-group-82034c4b-c190-494e-a320-9af6e1e19434 completed successfully.
Apr 02 20:59:21.687897 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:21.855399 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:59:21.871652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] deleting rbd volume volume-1080a362-d941-4645-87f5-4bcb1c485cd7 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:59:22.365657 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 20:59:22.404109 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Volume volume-63e3a329-891c-4536-82af-31304434f89c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:59:22.404712 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] deleting parent snapshot volume-1080a362-d941-4645-87f5-4bcb1c485cd7.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 20:59:23.596683 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Created reservations ['279fe8b7-8d20-49a5-a3fd-e048d2483acf'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:23.632043 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-753698839 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-753698839, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:59:23.633811 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-753698839 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-753698839, it is now deprecated. Please use the default quota class for default quota.
Apr 02 20:59:23.657268 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Created reservations ['55bbfdaa-8226-48cc-ba89-15abb4d1b565', '394807d4-d95a-4d6f-a0b7-eea3ea585133', '5165b5d1-1620-49b7-b1ab-30af5daaa2ec', 'c4ee6c79-0de4-4d5e-927c-6189d9a3b802'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:23.847843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:23.962455 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:24.050635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:24.062419 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-139c80c8-ef06-48c3-9ba4-7478c970ad87 tempest-GroupsV314Test-202833462 None] Delete group completed successfully.
Apr 02 20:59:24.645961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:24.754991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:59:24.755759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] Volume volume-63e3a329-891c-4536-82af-31304434f89c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:59:24.772165 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] deleting rbd volume volume-63e3a329-891c-4536-82af-31304434f89c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:59:25.348276 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] Created reservations ['a213781d-b633-4fd8-8b6d-65a6c0f222fe'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:25.428506 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] Created reservations ['9f1f6c14-0895-4e5e-8faf-8c9f19ac5b15', '5551c159-6f8e-436c-8a3c-4d842b72f804', '4dd50569-1206-49e7-83f1-5172848b940a', 'db442522-b20b-4dee-83cc-dc50767fc8fa'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:25.553666 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:25.618138 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:25.667833 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:25.676563 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7a6d2b43-f7a5-4f3d-8a6f-2a660ed50c34 tempest-GroupsV314Test-202833462 None] Delete group completed successfully.
Apr 02 20:59:28.801200 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 20:59:28.802648 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:28.903110 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:28.964754 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:32.349715 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-a29c8151-8d82-4e9b-a222-a9fcad8fa442 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Terminate volume connection completed successfully.
Apr 02 20:59:32.353483 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-7b8bc333-a21f-4a06-860d-fd9d52a258dc req-a29c8151-8d82-4e9b-a222-a9fcad8fa442 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Deleting attachment d08df4f9-99ac-4e4a-9e86-ea7f13b3a808. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 20:59:34.090855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:59:34.122244 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Flow 'volume_create_manager' (0fa26f7d-1378-4ece-aadc-b97e1ba2d206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:34.130753 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8908782-1f8e-4974-8a9e-4e089f951ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.149596 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8908782-1f8e-4974-8a9e-4e089f951ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-190220956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0994ddbf-69ae-4875-8596-c6a9e0abb371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db5a48a47b9c4d5ba65674a8888209d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:59:34Z,use_quota=True,user_id='83249aafde8044a18d94b4a6f1a7f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.155915 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d6a1a8-ca96-454a-bcd6-0e842ed78e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.162046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d6a1a8-ca96-454a-bcd6-0e842ed78e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.170914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9426190-d236-4892-bb3d-6a5b7a1f0254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.176385 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9426190-d236-4892-bb3d-6a5b7a1f0254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0994ddbf-69ae-4875-8596-c6a9e0abb371', 'volume_name': 'volume-0994ddbf-69ae-4875-8596-c6a9e0abb371', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.182013 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15762b2-bbd3-453b-98bb-df10fec5dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.187131 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15762b2-bbd3-453b-98bb-df10fec5dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.194414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6fdb22-36ab-49f2-8235-b9bf8d597f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.196390 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Volume 0994ddbf-69ae-4875-8596-c6a9e0abb371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0994ddbf-69ae-4875-8596-c6a9e0abb371', 'volume_size': 1}
Apr 02 20:59:34.197197 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] creating volume 'volume-0994ddbf-69ae-4875-8596-c6a9e0abb371' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:59:34.198404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:34.283613 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:59:34.284285 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:59:34.288021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6fdb22-36ab-49f2-8235-b9bf8d597f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0994ddbf-69ae-4875-8596-c6a9e0abb371', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.293052 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13197e8-c200-43a7-8f41-ba67608827f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:34.303161 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Volume volume-0994ddbf-69ae-4875-8596-c6a9e0abb371 (0994ddbf-69ae-4875-8596-c6a9e0abb371): created successfully
Apr 02 20:59:34.306881 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13197e8-c200-43a7-8f41-ba67608827f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:34.312740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Flow 'volume_create_manager' (0fa26f7d-1378-4ece-aadc-b97e1ba2d206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:34.323578 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c3c0f0c1-01e1-44d6-968a-1849e97c0548 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Created volume successfully.
Apr 02 20:59:36.281533 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Lock "b'cinder-0994ddbf-69ae-4875-8596-c6a9e0abb371-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:59:36.337806 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:36.420095 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:59:36.420667 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Volume volume-0994ddbf-69ae-4875-8596-c6a9e0abb371 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:59:36.433785 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] deleting rbd volume volume-0994ddbf-69ae-4875-8596-c6a9e0abb371 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:59:36.784262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Created reservations ['cb2c370e-52c0-4bd5-b73f-e452007952aa', '7d765982-208b-41ca-8204-ad5ee42b8999', 'e1074cc1-b770-4bcb-9d08-8b7ab0cac4e4', '271ad0ee-f7d1-4242-aa25-bd23be939034'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:36.831754 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:36.864521 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:36.946055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:36.953972 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Deleted volume successfully.
Apr 02 20:59:36.975001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a68d3455-7e6d-45bc-b5f7-022177b34578 tempest-VolumeQuotasNegativeTestJSON-1936473953 None] Lock "b'cinder-0994ddbf-69ae-4875-8596-c6a9e0abb371-delete_volume'" released by "delete_volume" :: held 0.692s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 20:59:51.314825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 20:59:51.335396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Flow 'volume_create_manager' (45791915-a8b9-4b78-9429-bfe87f778e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:51.342529 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ff2b05-32f0-4bd4-9185-342c343d807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.358651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ff2b05-32f0-4bd4-9185-342c343d807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T20:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1180536244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1023e2af-7a76-4b1e-91f1-a110aa3b8ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f10744c26b4dbb9b125e1867ed60a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T20:59:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T20:59:51Z,use_quota=True,user_id='3c1b11db62434348a0cdc4cf20feaf29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.364874 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9293fd45-857c-421f-8457-c0097f20c588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.369358 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9293fd45-857c-421f-8457-c0097f20c588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.375092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5701c0b7-f3c9-4498-9136-38b28881ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.380301 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5701c0b7-f3c9-4498-9136-38b28881ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1023e2af-7a76-4b1e-91f1-a110aa3b8ff6', 'volume_name': 'volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6', 'volume_size': 2}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.385361 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6f1f2-0dd8-4a23-ab4c-3626ee5f8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.389479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a6f1f2-0dd8-4a23-ab4c-3626ee5f8d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.395612 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39b6e0b-217e-4c5e-9bdc-2e6c5e73eeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.397291 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Volume 1023e2af-7a76-4b1e-91f1-a110aa3b8ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6', 'volume_size': 2}
Apr 02 20:59:51.397913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] creating volume 'volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 20:59:51.398899 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:51.556287 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 20:59:51.561589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 20:59:51.571587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39b6e0b-217e-4c5e-9bdc-2e6c5e73eeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6', 'volume_size': 2}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.585125 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235d2627-2484-4fe7-a149-763feff4bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 20:59:51.606786 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Volume volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6 (1023e2af-7a76-4b1e-91f1-a110aa3b8ff6): created successfully
Apr 02 20:59:51.619486 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235d2627-2484-4fe7-a149-763feff4bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 20:59:51.634702 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Flow 'volume_create_manager' (45791915-a8b9-4b78-9429-bfe87f778e2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 20:59:51.656121 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4469b9ee-2373-45f0-ad28-dbb1eb86b56f tempest-VolumesCloneNegativeTest-1734599328 None] Created volume successfully.
Apr 02 20:59:52.471370 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Lock "b'cinder-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 20:59:52.505235 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:52.549711 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 20:59:52.550445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Volume volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 20:59:52.557943 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] deleting rbd volume volume-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 20:59:52.807964 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Created reservations ['aed60172-0f00-4642-be2e-e7b9cdd999d5', 'edd2b673-0f23-428d-90a8-74ab02608545', 'ee27771f-a33f-45b5-bb55-5db82ab3efc3', 'c7a134dc-3918-41e9-8d80-226536c18473'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 20:59:52.875777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:52.919373 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 20:59:52.961786 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 20:59:52.968887 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Deleted volume successfully.
Apr 02 20:59:52.984000 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bc0e5080-752e-4c5f-89dd-e10137beaf06 tempest-VolumesCloneNegativeTest-1734599328 None] Lock "b'cinder-1023e2af-7a76-4b1e-91f1-a110aa3b8ff6-delete_volume'" released by "delete_volume" :: held 0.513s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:00:05.878511 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c6db4bd6-e289-4752-9c95-844c88561fe4 req-5a762ddc-6b7e-4a40-a41d-7933e0500865 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Terminate volume connection completed successfully.
Apr 02 21:00:05.879207 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c6db4bd6-e289-4752-9c95-844c88561fe4 req-5a762ddc-6b7e-4a40-a41d-7933e0500865 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Deleting attachment a2576e3f-26d6-431c-a8f5-0af21b9d1494. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:00:07.370580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:00:07.393600 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Flow 'volume_create_manager' (0505cb19-22e6-4252-97ce-0430a96edb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:07.401921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00210973-4ee7-4f3d-b0dc-d75ad017f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:07.418095 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00210973-4ee7-4f3d-b0dc-d75ad017f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1350090028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8809048-f892-4bbb-9a82-f30cbbc8cf67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a3f8d3d3e94b31ab9aa73d8905b12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:00:07Z,use_quota=True,user_id='4eaee1ddad0041828fb2e65677e2da25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:07.424232 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5ab537-f138-478f-8c50-1eb3190a9bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:07.428665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5ab537-f138-478f-8c50-1eb3190a9bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:07.433937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94b2b65-4ef7-4884-987a-bb46b6147fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:07.520653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94b2b65-4ef7-4884-987a-bb46b6147fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'volume_name': 'volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dd550>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:07.528077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b5d974-b5ba-4543-b345-199e9b291ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:07.532107 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b5d974-b5ba-4543-b345-199e9b291ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:07.537492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ba541-2e76-4d04-a62a-31f981a04958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:07.538635 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume f8809048-f892-4bbb-9a82-f30cbbc8cf67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dd550>}
Apr 02 21:00:07.539559 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Cloning f8809048-f892-4bbb-9a82-f30cbbc8cf67 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:00:07.549282 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:00:07.560325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 0, 7, 554247)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:00:07.560843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:00:07.561269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:00:07.566347 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:00:07.567371 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:00:07.573693 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 0, 7, 571332)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:00:07.574120 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:00:07.574518 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:00:07.586818 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:07.690184 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] creating snapshot='volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:00:08.388742 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67.clone_snap' to 'volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:00:08.575735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:00:08.577434 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:00:08.577833 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:00:08.600434 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:00:08.602175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Marking volume f8809048-f892-4bbb-9a82-f30cbbc8cf67 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:00:08.611582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to f8809048-f892-4bbb-9a82-f30cbbc8cf67. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:00:08.612831 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Creating volume glance metadata for volume f8809048-f892-4bbb-9a82-f30cbbc8cf67 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:00:08.685516 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737ba541-2e76-4d04-a62a-31f981a04958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dd550>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:08.693251 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589adbc7-3e4d-4fd0-bf9b-d247a142436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:08.706644 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67 (f8809048-f892-4bbb-9a82-f30cbbc8cf67): created successfully
Apr 02 21:00:08.711049 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589adbc7-3e4d-4fd0-bf9b-d247a142436a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:08.717432 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Flow 'volume_create_manager' (0505cb19-22e6-4252-97ce-0430a96edb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:08.728157 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-74e21951-71a8-4dec-b7bb-c854ed75c1e8 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Created volume successfully.
Apr 02 21:00:11.972681 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c66c1c63-70c0-41cb-90a5-9805a657e91d req-106bfbf4-e328-4e66-a1d6-fa047eefd18b tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:00:12.725134 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c66c1c63-70c0-41cb-90a5-9805a657e91d req-106bfbf4-e328-4e66-a1d6-fa047eefd18b tempest-LiveAutoBlockMigrationV225Test-1782887781 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:00:12.726711 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-c66c1c63-70c0-41cb-90a5-9805a657e91d req-106bfbf4-e328-4e66-a1d6-fa047eefd18b tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:00:12.759466 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c66c1c63-70c0-41cb-90a5-9805a657e91d req-106bfbf4-e328-4e66-a1d6-fa047eefd18b tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Connection info returned from driver {'name': 'volumes/volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '557cb1ca-6203-4355-8900-29f11a66da15'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:00:12.817887 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c66c1c63-70c0-41cb-90a5-9805a657e91d req-106bfbf4-e328-4e66-a1d6-fa047eefd18b tempest-LiveAutoBlockMigrationV225Test-1782887781 None] attachment_update completed successfully.
Apr 02 21:00:13.834047 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:00:13.858589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (e1579786-92a3-4ced-974d-f4dbd3650f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:13.868211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105cdb95-3e97-4ffe-bb33-a4853241d1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:13.884867 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105cdb95-3e97-4ffe-bb33-a4853241d1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2094744454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=edb42d4f-4c36-43fc-9b81-4680a8054cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03d0fc36de405d87c8e99d209af9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:00:14Z,use_quota=True,user_id='449253ed73e04f47bcd09c3a1cca6e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:13.890851 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72927678-a260-4e27-a3be-9f9837898441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:13.895990 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72927678-a260-4e27-a3be-9f9837898441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:13.902308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ca22f9-b53c-4143-9198-091df87d7534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:13.906642 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ca22f9-b53c-4143-9198-091df87d7534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'volume_name': 'volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:13.912410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e59feaa-8a5f-4796-8eb0-eb56855401f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:13.916677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e59feaa-8a5f-4796-8eb0-eb56855401f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:13.921528 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2754b0e6-7504-4e86-9391-e2478592a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:13.922706 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Volume edb42d4f-4c36-43fc-9b81-4680a8054cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'volume_size': 1}
Apr 02 21:00:13.923209 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] creating volume 'volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:00:13.924848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:14.009705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:00:14.010190 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:00:14.014094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2754b0e6-7504-4e86-9391-e2478592a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:14.019057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99324356-07fb-42c9-8120-1cfe62c97899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:14.028511 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Volume volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5 (edb42d4f-4c36-43fc-9b81-4680a8054cf5): created successfully
Apr 02 21:00:14.032258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99324356-07fb-42c9-8120-1cfe62c97899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:14.037976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (e1579786-92a3-4ced-974d-f4dbd3650f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:14.046962 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0194eba2-dab9-44e6-802d-54ee00ab5365 tempest-AttachVolumeTestJSON-889852705 None] Created volume successfully.
Apr 02 21:00:15.806935 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b req-8061db98-986d-4087-84cd-0602afbbf424 tempest-AttachVolumeTestJSON-889852705 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:00:16.494769 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b req-8061db98-986d-4087-84cd-0602afbbf424 tempest-AttachVolumeTestJSON-889852705 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:00:16.495578 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b req-8061db98-986d-4087-84cd-0602afbbf424 tempest-AttachVolumeTestJSON-889852705 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:00:16.527328 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b req-8061db98-986d-4087-84cd-0602afbbf424 tempest-AttachVolumeTestJSON-889852705 None] Connection info returned from driver {'name': 'volumes/volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'edb42d4f-4c36-43fc-9b81-4680a8054cf5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '27281ad9-0d54-4a78-b645-248f5c86f126'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:00:16.590868 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-d9bc941a-971d-4fe4-8126-d3bfc0469e0b req-8061db98-986d-4087-84cd-0602afbbf424 tempest-AttachVolumeTestJSON-889852705 None] attachment_update completed successfully.
Apr 02 21:00:23.241409 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:00:23.295160 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Flow 'volume_create_manager' (b4b3c846-4b3d-4bcd-9669-7c1d97064a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:23.328764 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6078a937-a87f-4a88-a6ed-4a6d2c593cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.357828 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6078a937-a87f-4a88-a6ed-4a6d2c593cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1419862977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=35aae13b-58e7-47bc-9a5c-0ca232ff5912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4f1507b69e40c8ace9eac029f1ced2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:00:23Z,use_quota=True,user_id='eaa8ffe0235f4759bdb071a51ad51410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.372951 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44d61d4-15a1-40a6-b78f-5f91117e2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.377889 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44d61d4-15a1-40a6-b78f-5f91117e2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.387654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5c6f2f-f764-49cc-ae5b-06065bd0914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.392643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5c6f2f-f764-49cc-ae5b-06065bd0914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'volume_name': 'volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.399717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2826c9-d6d0-4d8a-9e27-9019f16e5b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.404436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2826c9-d6d0-4d8a-9e27-9019f16e5b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.410347 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7464dad-a70d-4ed5-a121-9cd2bccc11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.411793 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume 35aae13b-58e7-47bc-9a5c-0ca232ff5912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'volume_size': 1}
Apr 02 21:00:23.412475 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] creating volume 'volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:00:23.414047 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:23.507548 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:00:23.507939 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:00:23.512968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7464dad-a70d-4ed5-a121-9cd2bccc11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.519615 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584151c5-fb9d-45c9-897c-704acfb44a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:00:23.549520 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912 (35aae13b-58e7-47bc-9a5c-0ca232ff5912): created successfully
Apr 02 21:00:23.555339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584151c5-fb9d-45c9-897c-704acfb44a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:00:23.563088 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Flow 'volume_create_manager' (b4b3c846-4b3d-4bcd-9669-7c1d97064a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:00:23.573515 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0217ca0c-c19d-4b99-897f-ecbdcc6a4c70 tempest-AttachVolumeShelveTestJSON-1397899499 None] Created volume successfully.
Apr 02 21:00:28.799972 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:00:28.800735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:28.845033 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:28.897098 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:00:31.078720 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-2ea1fc80-6e00-4978-97db-e308e44f6418 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:00:31.850092 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-2ea1fc80-6e00-4978-97db-e308e44f6418 tempest-LiveAutoBlockMigrationV225Test-253478136 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:00:31.850908 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-2ea1fc80-6e00-4978-97db-e308e44f6418 tempest-LiveAutoBlockMigrationV225Test-253478136 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:00:31.882582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-2ea1fc80-6e00-4978-97db-e308e44f6418 tempest-LiveAutoBlockMigrationV225Test-253478136 None] Connection info returned from driver {'name': 'volumes/volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f8809048-f892-4bbb-9a82-f30cbbc8cf67', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f5f45d8c-c268-4c41-a960-87c012c0b374'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:00:31.957202 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-2ea1fc80-6e00-4978-97db-e308e44f6418 tempest-LiveAutoBlockMigrationV225Test-253478136 None] attachment_update completed successfully.
Apr 02 21:00:39.452671 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-b1d78dbd-062a-4884-8695-1eea42f680ec tempest-LiveAutoBlockMigrationV225Test-253478136 None] Terminate volume connection completed successfully.
Apr 02 21:00:39.453750 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c2d90f04-9e9c-4ebb-adef-aef50aa50cfd req-b1d78dbd-062a-4884-8695-1eea42f680ec tempest-LiveAutoBlockMigrationV225Test-253478136 None] Deleting attachment 557cb1ca-6203-4355-8900-29f11a66da15. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:00:48.474469 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-0ab5de55-abe7-47d1-bfa3-52cbf7738f65 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Terminate volume connection completed successfully.
Apr 02 21:00:48.475218 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-0ab5de55-abe7-47d1-bfa3-52cbf7738f65 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Deleting attachment f5f45d8c-c268-4c41-a960-87c012c0b374. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:00:48.758028 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-f8809048-f892-4bbb-9a82-f30cbbc8cf67-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:00:48.825448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:48.968291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:00:48.980928 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] deleting rbd volume volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:00:49.430856 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-ce1d6038-17a9-4e87-9091-bac12977e2a7-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:00:49.467984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:00:49.516530 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] deleting parent snapshot volume-f8809048-f892-4bbb-9a82-f30cbbc8cf67.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:00:50.252984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Created reservations ['81707a21-6b9b-4372-87fa-38424c37c4e1', '10ef0bc8-d49b-4f05-aefe-e4cf5ff0e9ea', 'bf40d32e-6e09-47b9-854e-2a1bea5c11e7', '5fa97924-4d16-4b27-a1a1-3da7e769adf2'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:00:50.279072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:50.369201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:00:50.369681 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Volume volume-ce1d6038-17a9-4e87-9091-bac12977e2a7 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:00:50.389741 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] deleting rbd volume volume-ce1d6038-17a9-4e87-9091-bac12977e2a7 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:00:50.439342 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:50.503445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:50.573077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:00:50.578061 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Deleted volume successfully.
Apr 02 21:00:50.604181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-d0b2d6bb-59a7-4b73-a9f0-449abefb7836 req-dda5b951-e756-436f-b2ee-050af606f0ff tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-f8809048-f892-4bbb-9a82-f30cbbc8cf67-delete_volume'" released by "delete_volume" :: held 1.846s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:00:50.836925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Created reservations ['da0dc0d2-3d15-4d69-a80e-90ff12aa5b32', '7d822fe1-d3c3-4a32-a0e2-7c3ce68de006', '44921e73-145c-4875-90c2-82f08a977e17', '185bb74a-e903-4686-b5f8-938c9563d74c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:00:50.893224 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:50.929992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:00:51.009130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:00:51.013737 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Deleted volume successfully.
Apr 02 21:00:51.031098 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eb0899b2-57d4-4105-90e7-3861acb7ea88 tempest-LiveAutoBlockMigrationV225Test-1782887781 None] Lock "b'cinder-ce1d6038-17a9-4e87-9091-bac12977e2a7-delete_volume'" released by "delete_volume" :: held 1.600s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:01:05.573796 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc req-05eca790-49e1-43fd-a8db-b7a94e06cf0c tempest-AttachVolumeShelveTestJSON-1397899499 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:01:06.364984 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc req-05eca790-49e1-43fd-a8db-b7a94e06cf0c tempest-AttachVolumeShelveTestJSON-1397899499 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.791s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:01:06.367205 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc req-05eca790-49e1-43fd-a8db-b7a94e06cf0c tempest-AttachVolumeShelveTestJSON-1397899499 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:01:06.394499 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc req-05eca790-49e1-43fd-a8db-b7a94e06cf0c tempest-AttachVolumeShelveTestJSON-1397899499 None] Connection info returned from driver {'name': 'volumes/volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '35aae13b-58e7-47bc-9a5c-0ca232ff5912', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8ea65575-49a6-41b8-b54c-b008d6bbcd5f'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:01:06.480946 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-e1fe0ac2-1d31-4062-8839-db3e67de4ebc req-05eca790-49e1-43fd-a8db-b7a94e06cf0c tempest-AttachVolumeShelveTestJSON-1397899499 None] attachment_update completed successfully.
Apr 02 21:01:17.341297 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:01:17.396077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Flow 'volume_create_manager' (ad042b00-8199-469e-a4fd-e5cccb1980a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:01:17.414133 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad2d2fa-5ed8-4d40-9113-963383192017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.466480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad2d2fa-5ed8-4d40-9113-963383192017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-961534482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=86c9ac5d-fed3-4ddc-8558-865ff0a92915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67592663633d4cd89aed8f728fd7ca86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:01:17Z,use_quota=True,user_id='3dfe516204634bdd902f2e1236d7a6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.475059 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3a284d-8c50-4540-8db5-4d77192fdd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.480201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3a284d-8c50-4540-8db5-4d77192fdd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.488118 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bc925a-deb4-45fa-ae9b-e92298fa75c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.493067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bc925a-deb4-45fa-ae9b-e92298fa75c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'volume_name': 'volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.498689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3da121-8f42-429e-b3b7-8f74132869b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.503838 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c3da121-8f42-429e-b3b7-8f74132869b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.509082 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e5e3bc-e3a6-46dd-83b4-126f6911f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.510644 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Volume 86c9ac5d-fed3-4ddc-8558-865ff0a92915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'volume_size': 1}
Apr 02 21:01:17.511252 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] creating volume 'volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:01:17.512707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:01:17.611825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:01:17.612217 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:01:17.616268 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e5e3bc-e3a6-46dd-83b4-126f6911f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.625621 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c54c9f6-92a4-40e4-9d84-8c349d33f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:01:17.648150 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Volume volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915 (86c9ac5d-fed3-4ddc-8558-865ff0a92915): created successfully
Apr 02 21:01:17.653430 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c54c9f6-92a4-40e4-9d84-8c349d33f926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:01:17.669113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Flow 'volume_create_manager' (ad042b00-8199-469e-a4fd-e5cccb1980a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:01:17.727980 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d05ce776-3245-4a92-b3c8-6d75fa993a89 tempest-DeleteServersTestJSON-1658862532 None] Created volume successfully.
Apr 02 21:01:19.291064 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ee32416a-1937-4449-aa31-9796c16b7eb6 req-b3e20c8a-381e-449e-887c-b9d9acb2f812 tempest-DeleteServersTestJSON-1658862532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:01:20.013612 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ee32416a-1937-4449-aa31-9796c16b7eb6 req-b3e20c8a-381e-449e-887c-b9d9acb2f812 tempest-DeleteServersTestJSON-1658862532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.722s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:01:20.014544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ee32416a-1937-4449-aa31-9796c16b7eb6 req-b3e20c8a-381e-449e-887c-b9d9acb2f812 tempest-DeleteServersTestJSON-1658862532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:01:20.037003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-ee32416a-1937-4449-aa31-9796c16b7eb6 req-b3e20c8a-381e-449e-887c-b9d9acb2f812 tempest-DeleteServersTestJSON-1658862532 None] Connection info returned from driver {'name': 'volumes/volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86c9ac5d-fed3-4ddc-8558-865ff0a92915', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b92bc83b-2809-44d8-9c76-16b6ab2bd6de'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:01:20.084936 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-ee32416a-1937-4449-aa31-9796c16b7eb6 req-b3e20c8a-381e-449e-887c-b9d9acb2f812 tempest-DeleteServersTestJSON-1658862532 None] attachment_update completed successfully.
Apr 02 21:01:26.155325 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 req-a13cc24b-dfee-4bd6-a7dc-553f9e809218 tempest-DeleteServersTestJSON-1658862532 None] Terminate volume connection completed successfully.
Apr 02 21:01:26.158121 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-4a31fffc-9473-40b3-b516-af52a8fdc6b7 req-a13cc24b-dfee-4bd6-a7dc-553f9e809218 tempest-DeleteServersTestJSON-1658862532 None] Deleting attachment b92bc83b-2809-44d8-9c76-16b6ab2bd6de. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:01:28.803558 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:01:28.804484 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:01:28.883889 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:01:28.957013 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:01:41.945701 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-44bfc711-bf9e-42f0-a11e-b011e33a1305 req-d78660ba-42a2-4e57-8c64-e49f2c34c7e8 tempest-AttachVolumeTestJSON-889852705 None] Terminate volume connection completed successfully.
Apr 02 21:01:41.947021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-44bfc711-bf9e-42f0-a11e-b011e33a1305 req-d78660ba-42a2-4e57-8c64-e49f2c34c7e8 tempest-AttachVolumeTestJSON-889852705 None] Deleting attachment 27281ad9-0d54-4a78-b645-248f5c86f126. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:02:28.805012 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:02:28.805805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:02:28.876699 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:02:28.944395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:02:40.658822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:02:40.683036 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Flow 'volume_create_manager' (21331420-8b3a-4d85-b75d-ed37995f6a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:02:40.691092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff968c7-fde3-4387-9187-e8dbf04d38ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:40.721895 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff968c7-fde3-4387-9187-e8dbf04d38ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-352240430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e994c31e-ad27-4b77-9caa-844e2cd31983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf913c65b2ee4d168f38d2ffd7f02585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:02:41Z,use_quota=True,user_id='5bf97b33a7644fd9b2c92af3138f040c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:40.727932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6c042f-10b1-4775-883f-e8ea2a168c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:40.733467 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6c042f-10b1-4775-883f-e8ea2a168c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:40.740240 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da4b5af-9b54-4e48-96ba-b43becc277e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:41.020328 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da4b5af-9b54-4e48-96ba-b43becc277e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e994c31e-ad27-4b77-9caa-844e2cd31983', 'volume_name': 'volume-e994c31e-ad27-4b77-9caa-844e2cd31983', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ebe0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:41.034553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4600425f-8a45-447e-970f-0d4f4f3fee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:41.041341 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4600425f-8a45-447e-970f-0d4f4f3fee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:41.053895 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328ff141-e355-4105-93f3-a2ff9094a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:41.057195 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Volume e994c31e-ad27-4b77-9caa-844e2cd31983: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e994c31e-ad27-4b77-9caa-844e2cd31983', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ebe0>}
Apr 02 21:02:41.058650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Cloning e994c31e-ad27-4b77-9caa-844e2cd31983 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:02:41.086499 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.026s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:02:41.164340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 2, 41, 158887)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:02:41.164927 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:02:41.165446 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:02:41.171302 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.085s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:02:41.172415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:02:41.178886 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 2, 41, 175954)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:02:41.179393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:02:41.179907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:02:41.194189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:02:41.293260 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] creating snapshot='volume-e994c31e-ad27-4b77-9caa-844e2cd31983.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:02:42.228209 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-e994c31e-ad27-4b77-9caa-844e2cd31983.clone_snap' to 'volume-e994c31e-ad27-4b77-9caa-844e2cd31983' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:02:42.368665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:02:42.370101 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:02:42.370664 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:02:42.394525 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:02:42.395319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Marking volume e994c31e-ad27-4b77-9caa-844e2cd31983 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:02:42.409376 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to e994c31e-ad27-4b77-9caa-844e2cd31983. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:02:42.409953 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Creating volume glance metadata for volume e994c31e-ad27-4b77-9caa-844e2cd31983 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:02:42.495341 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328ff141-e355-4105-93f3-a2ff9094a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e994c31e-ad27-4b77-9caa-844e2cd31983', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ebe0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:42.500687 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7aad12-9d31-492c-8969-fea6d11a1304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:02:42.513542 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Volume volume-e994c31e-ad27-4b77-9caa-844e2cd31983 (e994c31e-ad27-4b77-9caa-844e2cd31983): created successfully
Apr 02 21:02:42.520419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7aad12-9d31-492c-8969-fea6d11a1304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:02:42.526248 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Flow 'volume_create_manager' (21331420-8b3a-4d85-b75d-ed37995f6a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:02:42.536570 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d7f6f253-4242-4dfe-88f5-a932dc826cba tempest-ServersTestBootFromVolume-28230648 None] Created volume successfully.
Apr 02 21:02:45.211928 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-23a35ceb-1886-4653-aef0-65105983386f req-4844dd97-3d35-43fd-a164-61569001c1ef tempest-ServersTestBootFromVolume-28230648 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:02:46.034854 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-23a35ceb-1886-4653-aef0-65105983386f req-4844dd97-3d35-43fd-a164-61569001c1ef tempest-ServersTestBootFromVolume-28230648 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.822s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:02:46.035869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-23a35ceb-1886-4653-aef0-65105983386f req-4844dd97-3d35-43fd-a164-61569001c1ef tempest-ServersTestBootFromVolume-28230648 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e994c31e-ad27-4b77-9caa-844e2cd31983', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'e994c31e-ad27-4b77-9caa-844e2cd31983', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:02:46.078474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-23a35ceb-1886-4653-aef0-65105983386f req-4844dd97-3d35-43fd-a164-61569001c1ef tempest-ServersTestBootFromVolume-28230648 None] Connection info returned from driver {'name': 'volumes/volume-e994c31e-ad27-4b77-9caa-844e2cd31983', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e994c31e-ad27-4b77-9caa-844e2cd31983', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'da986765-e74f-4d9c-904d-87471e88d316'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:02:46.140478 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-23a35ceb-1886-4653-aef0-65105983386f req-4844dd97-3d35-43fd-a164-61569001c1ef tempest-ServersTestBootFromVolume-28230648 None] attachment_update completed successfully.
Apr 02 21:02:52.984409 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c79822ba-4ea1-4945-b527-f20b73eaedb9 req-4b1b3cb3-dd70-4ce8-835e-9197dec9f7fe tempest-AttachVolumeShelveTestJSON-1397899499 None] Terminate volume connection completed successfully.
Apr 02 21:02:52.985561 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c79822ba-4ea1-4945-b527-f20b73eaedb9 req-4b1b3cb3-dd70-4ce8-835e-9197dec9f7fe tempest-AttachVolumeShelveTestJSON-1397899499 None] Deleting attachment 8ea65575-49a6-41b8-b54c-b008d6bbcd5f. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:03:26.955509 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:03:27.006166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Flow 'volume_create_manager' (8cf32655-38ea-460e-8345-62738d3c115c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:03:27.013023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf73760-c636-4d22-87ea-95a3de9768ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.031157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf73760-c636-4d22-87ea-95a3de9768ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1417787614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8016281-474e-40f1-96a1-36878763ad51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8431477fcd064f4f8ba2dedbed85b937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:03:27Z,use_quota=True,user_id='1925c01ee4d94de9a9a2e7d5735fea14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.037859 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df85338d-8572-4db6-a5ec-560f5a151d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.042469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df85338d-8572-4db6-a5ec-560f5a151d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.048800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6534f93-80db-43a4-8555-460ca282a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.053448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6534f93-80db-43a4-8555-460ca282a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8016281-474e-40f1-96a1-36878763ad51', 'volume_name': 'volume-a8016281-474e-40f1-96a1-36878763ad51', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.058882 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396da381-dfe8-496f-8da7-c4ecd533f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.063648 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (396da381-dfe8-496f-8da7-c4ecd533f79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.069251 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926fd333-2ccb-45fa-a0f7-a869c020b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.070671 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Volume a8016281-474e-40f1-96a1-36878763ad51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8016281-474e-40f1-96a1-36878763ad51', 'volume_size': 1}
Apr 02 21:03:27.071389 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] creating volume 'volume-a8016281-474e-40f1-96a1-36878763ad51' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:03:27.072704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:27.488121 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:03:27.490230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:03:27.495272 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926fd333-2ccb-45fa-a0f7-a869c020b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8016281-474e-40f1-96a1-36878763ad51', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.529562 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79610cc-f9c2-4b5e-99e0-c39a360cf06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:27.557512 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Volume volume-a8016281-474e-40f1-96a1-36878763ad51 (a8016281-474e-40f1-96a1-36878763ad51): created successfully
Apr 02 21:03:27.567869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e79610cc-f9c2-4b5e-99e0-c39a360cf06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:27.591767 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Flow 'volume_create_manager' (8cf32655-38ea-460e-8345-62738d3c115c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:03:27.618286 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-665ac1b5-3bd2-438a-a887-593bd4541c85 tempest-VolumesAdminNegativeTest-1843338013 None] Created volume successfully.
Apr 02 21:03:28.810476 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:03:28.811270 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:28.881447 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:28.925705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:03:28.971794 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee req-404e3027-2956-47aa-a8f6-bc7c4b401405 tempest-VolumesAdminNegativeTest-1843338013 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:03:30.251965 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee req-404e3027-2956-47aa-a8f6-bc7c4b401405 tempest-VolumesAdminNegativeTest-1843338013 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.280s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:03:30.252903 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee req-404e3027-2956-47aa-a8f6-bc7c4b401405 tempest-VolumesAdminNegativeTest-1843338013 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8016281-474e-40f1-96a1-36878763ad51', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'a8016281-474e-40f1-96a1-36878763ad51', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:03:30.317221 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee req-404e3027-2956-47aa-a8f6-bc7c4b401405 tempest-VolumesAdminNegativeTest-1843338013 None] Connection info returned from driver {'name': 'volumes/volume-a8016281-474e-40f1-96a1-36878763ad51', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8016281-474e-40f1-96a1-36878763ad51', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cf306090-d77e-4eca-9919-d0a0808f20a5'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:03:30.412024 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a0d12a86-e67a-4cb4-9fe7-d9c6bdf1b7ee req-404e3027-2956-47aa-a8f6-bc7c4b401405 tempest-VolumesAdminNegativeTest-1843338013 None] attachment_update completed successfully.
Apr 02 21:03:35.026894 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8a14cf3c-b8b3-4c15-944c-feb69183d7de req-da4c4da9-1c60-45f9-b7a4-3d189f331db4 tempest-VolumesAdminNegativeTest-1843338013 None] Terminate volume connection completed successfully.
Apr 02 21:03:35.027569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8a14cf3c-b8b3-4c15-944c-feb69183d7de req-da4c4da9-1c60-45f9-b7a4-3d189f331db4 tempest-VolumesAdminNegativeTest-1843338013 None] Deleting attachment cf306090-d77e-4eca-9919-d0a0808f20a5. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:03:36.297862 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:03:36.320598 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Flow 'volume_create_manager' (13b01b36-0bce-4afd-9a82-714812a4368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:03:36.327805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158d3ebb-a529-498f-af14-a5fa17d77a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.344195 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158d3ebb-a529-498f-af14-a5fa17d77a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1101005632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e42c72d-7ae4-49bb-b651-7ca2439ae6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8431477fcd064f4f8ba2dedbed85b937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:03:36Z,use_quota=True,user_id='1925c01ee4d94de9a9a2e7d5735fea14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.350757 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92127437-76d1-4729-a1ba-897ae3811726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.355066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92127437-76d1-4729-a1ba-897ae3811726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.360961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d315df-5b8e-4836-8681-37f97dc1e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.365310 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d315df-5b8e-4836-8681-37f97dc1e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e42c72d-7ae4-49bb-b651-7ca2439ae6c1', 'volume_name': 'volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.372055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff6fd7d-386e-4812-b42d-0951710aab7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.377724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff6fd7d-386e-4812-b42d-0951710aab7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.382624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90638a7a-60c6-4871-8341-b64df78cda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.383734 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Volume 0e42c72d-7ae4-49bb-b651-7ca2439ae6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1', 'volume_size': 1}
Apr 02 21:03:36.385977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] creating volume 'volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:03:36.388235 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:36.476820 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:03:36.477521 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:03:36.482293 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90638a7a-60c6-4871-8341-b64df78cda52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.489114 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90b370e-c1dc-4a12-ae71-aaddd0cf0cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:03:36.505378 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Volume volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1 (0e42c72d-7ae4-49bb-b651-7ca2439ae6c1): created successfully
Apr 02 21:03:36.509461 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90b370e-c1dc-4a12-ae71-aaddd0cf0cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:03:36.515654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Flow 'volume_create_manager' (13b01b36-0bce-4afd-9a82-714812a4368d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:03:36.528859 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d17d599b-225f-4bb2-8d49-fe1abd3d2228 tempest-VolumesAdminNegativeTest-1843338013 None] Created volume successfully.
Apr 02 21:03:37.434494 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Lock "b'cinder-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:03:37.511855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:37.581340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:03:37.582900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Volume volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:03:37.590035 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] deleting rbd volume volume-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:03:37.859967 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Created reservations ['7174a560-69be-4317-824b-860c82b4acec', '2a084587-4c21-409a-bb9c-a30fadf76aee', '2dfe861b-8a03-4819-ad6f-857f38c3ac53', '44f63c34-06a3-43bf-9c2d-ed77a9457626'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:03:37.906248 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:37.938609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:37.971704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:03:37.978969 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Deleted volume successfully.
Apr 02 21:03:37.992257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-77976c06-f0ca-4deb-954c-1a32b72ec80f tempest-VolumesAdminNegativeTest-1843338013 None] Lock "b'cinder-0e42c72d-7ae4-49bb-b651-7ca2439ae6c1-delete_volume'" released by "delete_volume" :: held 0.558s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:03:38.571326 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Lock "b'cinder-a8016281-474e-40f1-96a1-36878763ad51-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:03:38.601071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:38.637607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:03:38.637960 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Volume volume-a8016281-474e-40f1-96a1-36878763ad51 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:03:38.643892 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] deleting rbd volume volume-a8016281-474e-40f1-96a1-36878763ad51 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:03:38.901590 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Created reservations ['ac9fdfd7-b321-4f18-a078-54e46f892238', 'cd64fba6-71a8-4024-90f4-3a62df924711', 'b9969d7b-025e-4aa9-a7de-596e2cac694c', '40f7b95b-992c-4895-b231-d6fccc22ed61'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:03:38.953877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:38.987938 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:03:39.019975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:03:39.024086 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Deleted volume successfully.
Apr 02 21:03:39.037398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a2f85d6b-1eb1-4a48-9012-a70bdfac0c90 tempest-VolumesAdminNegativeTest-1843338013 None] Lock "b'cinder-a8016281-474e-40f1-96a1-36878763ad51-delete_volume'" released by "delete_volume" :: held 0.466s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:04:07.258135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Lock "b'cinder-86c9ac5d-fed3-4ddc-8558-865ff0a92915-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:04:07.391587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:07.493504 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:04:07.493965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Volume volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:04:07.510387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] deleting rbd volume volume-86c9ac5d-fed3-4ddc-8558-865ff0a92915 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:04:08.272227 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Created reservations ['d21d750d-7449-42e5-b6d3-33bedbf7c6b8', 'e01d1629-f8c0-4144-b57f-a4dda3914656', '253b4f43-6e29-4037-89da-a6838ecf028a', '5cf842a6-fef2-4905-bd93-342ce3964e03'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:04:08.426358 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:08.533645 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:08.609553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:08.616095 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Deleted volume successfully.
Apr 02 21:04:08.642058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-02d340be-cc75-47ed-8a66-97f56cbf4d78 tempest-DeleteServersTestJSON-1658862532 None] Lock "b'cinder-86c9ac5d-fed3-4ddc-8558-865ff0a92915-delete_volume'" released by "delete_volume" :: held 1.384s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:04:14.526432 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-8ab9afda-ee12-497f-aa26-e8e4160acf74 tempest-ServersTestBootFromVolume-28230648 None] Terminate volume connection completed successfully.
Apr 02 21:04:14.527736 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-8ab9afda-ee12-497f-aa26-e8e4160acf74 tempest-ServersTestBootFromVolume-28230648 None] Deleting attachment da986765-e74f-4d9c-904d-87471e88d316. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:04:14.773380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] Lock "b'cinder-e994c31e-ad27-4b77-9caa-844e2cd31983-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:04:14.853029 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:14.950113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:04:14.968627 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] deleting rbd volume volume-e994c31e-ad27-4b77-9caa-844e2cd31983 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:04:15.551823 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:04:15.597283 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] deleting parent snapshot volume-e994c31e-ad27-4b77-9caa-844e2cd31983.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:04:16.525161 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] Created reservations ['c519e1b4-b2fe-41b6-9557-653f742eca40', '49779fa1-13a3-48b8-94c9-b4d98fe2a893', '2c0e3b5c-9a94-4bdb-888b-516ce104a05c', 'cfdc9739-83ae-43ae-a964-630bfb0b6a55'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:04:16.614791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:16.692097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:16.764068 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:16.768404 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] Deleted volume successfully.
Apr 02 21:04:16.792011 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-a3bdbd8b-5e8e-4d8e-8e63-ad205e9f6ec7 req-e2bb433b-36eb-4489-b645-3ed97b56618f tempest-ServersTestBootFromVolume-28230648 None] Lock "b'cinder-e994c31e-ad27-4b77-9caa-844e2cd31983-delete_volume'" released by "delete_volume" :: held 2.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:04:17.662781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:04:17.733255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (019a8346-2d91-45e5-9bb5-4b25d0090c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:17.741054 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c805586d-071f-440b-aa69-589c32a91b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.771331 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c805586d-071f-440b-aa69-589c32a91b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1674820744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0034258a-4e3b-426a-a2c4-7a067fe59f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03d0fc36de405d87c8e99d209af9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:04:18Z,use_quota=True,user_id='449253ed73e04f47bcd09c3a1cca6e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.791295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f81e67-cde5-48eb-a4b0-ed647f4d210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.797038 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f81e67-cde5-48eb-a4b0-ed647f4d210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.805913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785d159a-9356-4c3c-8022-d76a1eb761a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.813358 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (785d159a-9356-4c3c-8022-d76a1eb761a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0034258a-4e3b-426a-a2c4-7a067fe59f80', 'volume_name': 'volume-0034258a-4e3b-426a-a2c4-7a067fe59f80', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.819029 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b023b4f6-a1ad-4203-bb6f-fcb09127c521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.823171 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b023b4f6-a1ad-4203-bb6f-fcb09127c521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.828928 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9463c7f2-a337-4830-974c-06df6247445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.830486 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Volume 0034258a-4e3b-426a-a2c4-7a067fe59f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0034258a-4e3b-426a-a2c4-7a067fe59f80', 'volume_size': 1}
Apr 02 21:04:17.831132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] creating volume 'volume-0034258a-4e3b-426a-a2c4-7a067fe59f80' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:04:17.832710 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:17.933578 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:04:17.934325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:04:17.939176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9463c7f2-a337-4830-974c-06df6247445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0034258a-4e3b-426a-a2c4-7a067fe59f80', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.945287 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66187f94-fe36-448f-86bc-d46274b400da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:17.971352 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Volume volume-0034258a-4e3b-426a-a2c4-7a067fe59f80 (0034258a-4e3b-426a-a2c4-7a067fe59f80): created successfully
Apr 02 21:04:17.975684 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66187f94-fe36-448f-86bc-d46274b400da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:17.981224 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (019a8346-2d91-45e5-9bb5-4b25d0090c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:17.990531 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3fd2e19e-c0b7-4218-a106-ee5fc71868c6 tempest-AttachVolumeTestJSON-889852705 None] Created volume successfully.
Apr 02 21:04:19.569252 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-25e53df7-db90-41a4-9fe5-5f7e888c801b req-4262e35e-e4fc-4113-a30f-77eb10e2a771 tempest-AttachVolumeTestJSON-889852705 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:04:20.684563 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-25e53df7-db90-41a4-9fe5-5f7e888c801b req-4262e35e-e4fc-4113-a30f-77eb10e2a771 tempest-AttachVolumeTestJSON-889852705 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.116s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:04:20.685431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-25e53df7-db90-41a4-9fe5-5f7e888c801b req-4262e35e-e4fc-4113-a30f-77eb10e2a771 tempest-AttachVolumeTestJSON-889852705 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0034258a-4e3b-426a-a2c4-7a067fe59f80', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '0034258a-4e3b-426a-a2c4-7a067fe59f80', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:04:20.715521 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-25e53df7-db90-41a4-9fe5-5f7e888c801b req-4262e35e-e4fc-4113-a30f-77eb10e2a771 tempest-AttachVolumeTestJSON-889852705 None] Connection info returned from driver {'name': 'volumes/volume-0034258a-4e3b-426a-a2c4-7a067fe59f80', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0034258a-4e3b-426a-a2c4-7a067fe59f80', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e983dda3-9421-41d7-b31c-07f34db42562'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:04:20.782410 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-25e53df7-db90-41a4-9fe5-5f7e888c801b req-4262e35e-e4fc-4113-a30f-77eb10e2a771 tempest-AttachVolumeTestJSON-889852705 None] attachment_update completed successfully.
Apr 02 21:04:23.800719 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:04:23.841096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (28fe02e6-1b50-4e38-b3cd-9eaa6f62d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:23.849586 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bc688b-1daf-40d9-a2ef-66f7ac1c58a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:23.875837 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bc688b-1daf-40d9-a2ef-66f7ac1c58a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751153246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd15cb3b-4950-4474-9ff9-8e934132619b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da03d0fc36de405d87c8e99d209af9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:04:24Z,use_quota=True,user_id='449253ed73e04f47bcd09c3a1cca6e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:23.882142 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c44014-b30c-4887-8708-9f029987316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:23.887023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c44014-b30c-4887-8708-9f029987316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:23.893900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a74d02-f556-4ed1-a38c-9d22b661834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:23.898557 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a74d02-f556-4ed1-a38c-9d22b661834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd15cb3b-4950-4474-9ff9-8e934132619b', 'volume_name': 'volume-bd15cb3b-4950-4474-9ff9-8e934132619b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:23.903818 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7336abf-347d-42a1-b82a-11683c15ae7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:23.910566 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7336abf-347d-42a1-b82a-11683c15ae7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:23.918333 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cad41-7ecd-4ed1-86bc-1610962f4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:23.920035 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Volume bd15cb3b-4950-4474-9ff9-8e934132619b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd15cb3b-4950-4474-9ff9-8e934132619b', 'volume_size': 1}
Apr 02 21:04:23.920471 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] creating volume 'volume-bd15cb3b-4950-4474-9ff9-8e934132619b' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:04:23.921433 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:24.045304 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:04:24.046051 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:04:24.054271 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cad41-7ecd-4ed1-86bc-1610962f4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd15cb3b-4950-4474-9ff9-8e934132619b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:24.061791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33114f2-3f96-4e7e-a993-6a76b2ce72f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:24.075444 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Volume volume-bd15cb3b-4950-4474-9ff9-8e934132619b (bd15cb3b-4950-4474-9ff9-8e934132619b): created successfully
Apr 02 21:04:24.081650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33114f2-3f96-4e7e-a993-6a76b2ce72f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:24.090418 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Flow 'volume_create_manager' (28fe02e6-1b50-4e38-b3cd-9eaa6f62d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:24.109246 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d7439306-9022-4a8c-bb04-688dc2134207 tempest-AttachVolumeTestJSON-889852705 None] Created volume successfully.
Apr 02 21:04:25.428861 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-f3b746f6-69be-4454-a06f-1b538597c3e7 req-97047feb-33af-4c37-bf0a-ea60b9989d9a tempest-AttachVolumeTestJSON-889852705 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:04:26.141540 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-f3b746f6-69be-4454-a06f-1b538597c3e7 req-97047feb-33af-4c37-bf0a-ea60b9989d9a tempest-AttachVolumeTestJSON-889852705 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.713s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:04:26.142908 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-f3b746f6-69be-4454-a06f-1b538597c3e7 req-97047feb-33af-4c37-bf0a-ea60b9989d9a tempest-AttachVolumeTestJSON-889852705 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bd15cb3b-4950-4474-9ff9-8e934132619b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'bd15cb3b-4950-4474-9ff9-8e934132619b', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:04:26.178062 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-f3b746f6-69be-4454-a06f-1b538597c3e7 req-97047feb-33af-4c37-bf0a-ea60b9989d9a tempest-AttachVolumeTestJSON-889852705 None] Connection info returned from driver {'name': 'volumes/volume-bd15cb3b-4950-4474-9ff9-8e934132619b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'bd15cb3b-4950-4474-9ff9-8e934132619b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6be99b4-d3f7-413c-924b-afe8e4bd6b74'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:04:26.235201 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-f3b746f6-69be-4454-a06f-1b538597c3e7 req-97047feb-33af-4c37-bf0a-ea60b9989d9a tempest-AttachVolumeTestJSON-889852705 None] attachment_update completed successfully.
Apr 02 21:04:28.807597 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:04:28.808759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:28.870510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:28.916969 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:30.049963 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-805b7e60-faab-4681-b6ec-8a250d41cb61 req-4ff3b342-6bca-486c-85c4-dcd2d0239ac4 tempest-AttachVolumeTestJSON-889852705 None] Terminate volume connection completed successfully.
Apr 02 21:04:30.051015 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-805b7e60-faab-4681-b6ec-8a250d41cb61 req-4ff3b342-6bca-486c-85c4-dcd2d0239ac4 tempest-AttachVolumeTestJSON-889852705 None] Deleting attachment e983dda3-9421-41d7-b31c-07f34db42562. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:04:31.538184 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe req-61084b3e-42fb-48d0-a381-d7789918dc43 tempest-AttachVolumeTestJSON-889852705 None] Terminate volume connection completed successfully.
Apr 02 21:04:31.539501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-16c44d62-4f82-46d1-8b56-dbb6c5d309fe req-61084b3e-42fb-48d0-a381-d7789918dc43 tempest-AttachVolumeTestJSON-889852705 None] Deleting attachment f6be99b4-d3f7-413c-924b-afe8e4bd6b74. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:04:40.505114 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-bd15cb3b-4950-4474-9ff9-8e934132619b-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:04:40.557390 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:40.677007 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:04:40.677493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Volume volume-bd15cb3b-4950-4474-9ff9-8e934132619b is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:04:40.699565 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] deleting rbd volume volume-bd15cb3b-4950-4474-9ff9-8e934132619b {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:04:41.275935 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Created reservations ['3b0b68f2-e758-448c-af29-c50765aab849', 'e122a85a-3eae-4a48-8f2b-bc3d4b8d1c62', 'cb21e14d-5677-482e-82f3-bfd7f33a7eb5', 'c82e2e91-0988-4f6b-b890-0dc5eaec1350'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:04:41.363616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:41.426129 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:41.511089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:41.524918 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Deleted volume successfully.
Apr 02 21:04:41.568764 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a1ce68eb-34b5-4434-b417-0a14623c2988 tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-bd15cb3b-4950-4474-9ff9-8e934132619b-delete_volume'" released by "delete_volume" :: held 1.063s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:04:41.797366 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-0034258a-4e3b-426a-a2c4-7a067fe59f80-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:04:41.944912 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:42.067962 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:04:42.068399 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Volume volume-0034258a-4e3b-426a-a2c4-7a067fe59f80 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:04:42.088134 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] deleting rbd volume volume-0034258a-4e3b-426a-a2c4-7a067fe59f80 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:04:42.593668 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Created reservations ['a426e19a-9200-48be-8457-8926e74c061a', '71078b90-4bed-4399-9331-b71f99c8c9d4', 'ab08b7fe-23e5-4023-93cf-c3d3edbb6dea', 'cb4405e0-7506-44a0-b905-709b15782a4a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:04:42.707321 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:42.806924 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:42.890905 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:42.917370 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Deleted volume successfully.
Apr 02 21:04:42.945880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80a01a40-e40d-4f79-9a01-fd20dc99d766 tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-0034258a-4e3b-426a-a2c4-7a067fe59f80-delete_volume'" released by "delete_volume" :: held 1.149s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:04:42.950639 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:04:42.986147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Flow 'volume_create_manager' (f7962599-c04a-4f72-8612-db10fe7be004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:43.015681 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1335bb92-59a8-4a93-b4e1-a3a3d78c66d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.037390 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1335bb92-59a8-4a93-b4e1-a3a3d78c66d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-736178730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1e69b880-61ea-4a88-8197-f35a7b853345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4f1507b69e40c8ace9eac029f1ced2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:04:43Z,use_quota=True,user_id='eaa8ffe0235f4759bdb071a51ad51410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.042964 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ee60d-9a32-4c96-b9c6-d267e91538e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.048611 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ee60d-9a32-4c96-b9c6-d267e91538e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.054089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44849a24-2593-4e70-b8e1-ae8c00dbcc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.058271 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44849a24-2593-4e70-b8e1-ae8c00dbcc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e69b880-61ea-4a88-8197-f35a7b853345', 'volume_name': 'volume-1e69b880-61ea-4a88-8197-f35a7b853345', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.064168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d800f0c5-f89c-479c-98f9-1bf9981ee3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.068534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d800f0c5-f89c-479c-98f9-1bf9981ee3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.075281 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a42332-92af-437c-a585-e26b36346cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.076410 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume 1e69b880-61ea-4a88-8197-f35a7b853345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e69b880-61ea-4a88-8197-f35a7b853345', 'volume_size': 1}
Apr 02 21:04:43.076839 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] creating volume 'volume-1e69b880-61ea-4a88-8197-f35a7b853345' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:04:43.078216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:43.160155 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-edb42d4f-4c36-43fc-9b81-4680a8054cf5-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:04:43.211546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:04:43.211927 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:04:43.216421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a42332-92af-437c-a585-e26b36346cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e69b880-61ea-4a88-8197-f35a7b853345', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.221134 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c1e89f-9d8d-4deb-bc19-493168913f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:04:43.230468 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:43.285327 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:04:43.285753 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Volume volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:04:43.295181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] deleting rbd volume volume-edb42d4f-4c36-43fc-9b81-4680a8054cf5 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:04:43.298139 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume volume-1e69b880-61ea-4a88-8197-f35a7b853345 (1e69b880-61ea-4a88-8197-f35a7b853345): created successfully
Apr 02 21:04:43.308510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c1e89f-9d8d-4deb-bc19-493168913f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:04:43.316160 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Flow 'volume_create_manager' (f7962599-c04a-4f72-8612-db10fe7be004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:04:43.330391 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e5338634-023d-41d6-aa50-f3a4147fe604 tempest-AttachVolumeShelveTestJSON-1397899499 None] Created volume successfully.
Apr 02 21:04:43.547885 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Created reservations ['eda82103-afc9-4be4-b77c-96d517b1b356', '6dc00cf5-4c50-43b9-9518-925fe4aedfb1', 'e057f6f5-04de-4300-9177-78ea285e2bb5', 'e1a9d055-e505-494c-a866-b2de0a8a6e4a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:04:43.608265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:43.692586 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:04:43.728117 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:04:43.733870 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Deleted volume successfully.
Apr 02 21:04:43.746201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3c7ed325-4455-4bd5-a3c9-71fc300366ea tempest-AttachVolumeTestJSON-889852705 None] Lock "b'cinder-edb42d4f-4c36-43fc-9b81-4680a8054cf5-delete_volume'" released by "delete_volume" :: held 0.586s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:05:00.080000 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:05:00.130503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (d50a0611-9e9c-4735-8b9c-14fd65f5edee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:00.153826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee63b8dd-ea2c-4571-8d02-962a71b57a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:00.176836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee63b8dd-ea2c-4571-8d02-962a71b57a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-189299289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4745418f-c52c-437e-a1b1-9414ea2b7f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad5516982b843a9a35e49795fda0844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:05:00Z,use_quota=True,user_id='ee1c48c096304c819e0eac11e84aef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:00.183669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5748d66-cfed-4e6f-87fd-3e65bf2ab2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:00.188705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5748d66-cfed-4e6f-87fd-3e65bf2ab2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:00.196518 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f41b97-bb51-4319-ac15-978b57f53c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:00.331822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f41b97-bb51-4319-ac15-978b57f53c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'volume_name': 'volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953c4790>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:00.339547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69dfbcd4-1d76-4096-80e9-740059cee895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:00.353131 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69dfbcd4-1d76-4096-80e9-740059cee895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:00.372697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a836961c-8767-47af-a682-2d96e56f2ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:00.374171 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Volume 4745418f-c52c-437e-a1b1-9414ea2b7f8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953c4790>}
Apr 02 21:05:00.374774 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Cloning 4745418f-c52c-437e-a1b1-9414ea2b7f8a from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:05:00.395695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:05:00.420098 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 5, 0, 404168)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:05:00.420564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:05:00.422325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:05:00.431371 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.037s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:05:00.432608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:05:00.453415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 5, 0, 441350)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:05:00.453776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:05:00.456560 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:05:00.487237 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:00.600496 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] creating snapshot='volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:05:01.294300 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a.clone_snap' to 'volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:05:01.501270 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:05:01.502844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:05:01.503764 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:05:01.544792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:05:01.545335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Marking volume 4745418f-c52c-437e-a1b1-9414ea2b7f8a as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:05:01.559883 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 4745418f-c52c-437e-a1b1-9414ea2b7f8a. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:05:01.560431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Creating volume glance metadata for volume 4745418f-c52c-437e-a1b1-9414ea2b7f8a backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:05:01.656651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a836961c-8767-47af-a682-2d96e56f2ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953c4790>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:01.675730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4323cb-071c-4787-9138-fb5e2d232a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:01.726156 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Volume volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a (4745418f-c52c-437e-a1b1-9414ea2b7f8a): created successfully
Apr 02 21:05:01.745995 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4323cb-071c-4787-9138-fb5e2d232a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:01.753137 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (d50a0611-9e9c-4735-8b9c-14fd65f5edee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:01.787542 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4daae86-b2c5-4752-9553-3621d8d4b129 tempest-TaggedBootDevicesTest-776080868 None] Created volume successfully.
Apr 02 21:05:02.779766 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:05:02.808180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (fbf10887-80ed-47e2-b0b0-39294ac7cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:02.815503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bab917-749a-42fc-b4be-5bb0677be972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:02.845132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bab917-749a-42fc-b4be-5bb0677be972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-76386570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=afc1ced9-2e41-456b-991e-0deebbfcdc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad5516982b843a9a35e49795fda0844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:05:03Z,use_quota=True,user_id='ee1c48c096304c819e0eac11e84aef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:02.858904 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e146040a-0172-4c11-8bc7-2c2608b5b045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:02.877146 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e146040a-0172-4c11-8bc7-2c2608b5b045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:02.894263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a31faa7-18b3-4d76-b202-8ce9fdd19c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:02.906325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a31faa7-18b3-4d76-b202-8ce9fdd19c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc1ced9-2e41-456b-991e-0deebbfcdc27', 'volume_name': 'volume-afc1ced9-2e41-456b-991e-0deebbfcdc27', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:02.923783 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8a37f-3b65-41dc-b7fa-f93a1d6317af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:02.940685 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8a37f-3b65-41dc-b7fa-f93a1d6317af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:02.967027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5491489-8fac-4892-b324-ec4f9c833fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:02.969360 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Volume afc1ced9-2e41-456b-991e-0deebbfcdc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc1ced9-2e41-456b-991e-0deebbfcdc27', 'volume_size': 1}
Apr 02 21:05:02.970125 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] creating volume 'volume-afc1ced9-2e41-456b-991e-0deebbfcdc27' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:05:02.972955 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:03.138379 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:05:03.139010 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:05:03.144054 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5491489-8fac-4892-b324-ec4f9c833fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc1ced9-2e41-456b-991e-0deebbfcdc27', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:03.151925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9938c8b9-aabf-4a28-a4f8-373433e1727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:03.180965 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Volume volume-afc1ced9-2e41-456b-991e-0deebbfcdc27 (afc1ced9-2e41-456b-991e-0deebbfcdc27): created successfully
Apr 02 21:05:03.184855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9938c8b9-aabf-4a28-a4f8-373433e1727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:03.200695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (fbf10887-80ed-47e2-b0b0-39294ac7cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:03.230777 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-5b70a3d1-c89e-4d0d-8586-b81227239796 tempest-TaggedBootDevicesTest-776080868 None] Created volume successfully.
Apr 02 21:05:04.262552 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:05:04.291550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (f2bfe6af-df42-48e4-9a8f-a38c363bee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:04.304921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1d1aa-6ad9-4103-aea5-8cbb4505ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.332722 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c1d1aa-6ad9-4103-aea5-8cbb4505ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-89720462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=353e1bda-2e9a-4abd-84bc-8d3fc2f65146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad5516982b843a9a35e49795fda0844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:05:04Z,use_quota=True,user_id='ee1c48c096304c819e0eac11e84aef26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.343505 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c90410-a7c1-433f-9f77-7fe1c1c26d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.350403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c90410-a7c1-433f-9f77-7fe1c1c26d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.358762 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90c9006-3898-4f07-92d3-7a66cae73dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.365607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90c9006-3898-4f07-92d3-7a66cae73dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'volume_name': 'volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.376312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8c888e-b74b-4708-a2bb-3828de0600ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.382236 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8c888e-b74b-4708-a2bb-3828de0600ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.389224 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc8a058-9291-4d59-b4b6-3e580194822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.390777 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Volume 353e1bda-2e9a-4abd-84bc-8d3fc2f65146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'volume_size': 1}
Apr 02 21:05:04.391466 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] creating volume 'volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:05:04.392290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:04.539309 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:05:04.540399 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:05:04.550364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc8a058-9291-4d59-b4b6-3e580194822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.556701 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff126b1-dd51-4174-a106-45ae5a88ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:04.573600 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Volume volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146 (353e1bda-2e9a-4abd-84bc-8d3fc2f65146): created successfully
Apr 02 21:05:04.579262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff126b1-dd51-4174-a106-45ae5a88ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:04.600817 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Flow 'volume_create_manager' (f2bfe6af-df42-48e4-9a8f-a38c363bee20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:04.616808 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b32c237b-ac24-4f43-bf24-5dc1558ace65 tempest-TaggedBootDevicesTest-776080868 None] Created volume successfully.
Apr 02 21:05:24.650820 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-fe536b35-c0ac-4d0d-903f-15087bec58f3 tempest-TaggedBootDevicesTest-776080868 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:05:26.023672 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-fe536b35-c0ac-4d0d-903f-15087bec58f3 tempest-TaggedBootDevicesTest-776080868 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.372s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:05:26.025099 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-fe536b35-c0ac-4d0d-903f-15087bec58f3 tempest-TaggedBootDevicesTest-776080868 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:05:26.110534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-fe536b35-c0ac-4d0d-903f-15087bec58f3 tempest-TaggedBootDevicesTest-776080868 None] Connection info returned from driver {'name': 'volumes/volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4745418f-c52c-437e-a1b1-9414ea2b7f8a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6d30e13b-cdc8-4165-b725-b3b6cd7a92f0'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:05:26.197814 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-fe536b35-c0ac-4d0d-903f-15087bec58f3 tempest-TaggedBootDevicesTest-776080868 None] attachment_update completed successfully.
Apr 02 21:05:26.623483 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-9987a9f3-a8d8-456f-9f03-84d795cabe00 tempest-TaggedBootDevicesTest-776080868 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:05:28.015663 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-9987a9f3-a8d8-456f-9f03-84d795cabe00 tempest-TaggedBootDevicesTest-776080868 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.392s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:05:28.016738 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-9987a9f3-a8d8-456f-9f03-84d795cabe00 tempest-TaggedBootDevicesTest-776080868 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-afc1ced9-2e41-456b-991e-0deebbfcdc27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'afc1ced9-2e41-456b-991e-0deebbfcdc27', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:05:28.089843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-9987a9f3-a8d8-456f-9f03-84d795cabe00 tempest-TaggedBootDevicesTest-776080868 None] Connection info returned from driver {'name': 'volumes/volume-afc1ced9-2e41-456b-991e-0deebbfcdc27', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'afc1ced9-2e41-456b-991e-0deebbfcdc27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47b18cd0-a91e-44ff-8bad-6730e79977cd'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:05:28.225224 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-9987a9f3-a8d8-456f-9f03-84d795cabe00 tempest-TaggedBootDevicesTest-776080868 None] attachment_update completed successfully.
Apr 02 21:05:28.664115 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-58d2c62b-a531-4c3a-bf1f-06fb408db12a tempest-TaggedBootDevicesTest-776080868 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:05:28.813838 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:05:28.815445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:28.920693 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:29.011780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:05:29.813527 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-58d2c62b-a531-4c3a-bf1f-06fb408db12a tempest-TaggedBootDevicesTest-776080868 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.149s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:05:29.815016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-58d2c62b-a531-4c3a-bf1f-06fb408db12a tempest-TaggedBootDevicesTest-776080868 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:05:29.839881 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-58d2c62b-a531-4c3a-bf1f-06fb408db12a tempest-TaggedBootDevicesTest-776080868 None] Connection info returned from driver {'name': 'volumes/volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '353e1bda-2e9a-4abd-84bc-8d3fc2f65146', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b2de6f82-6a2e-47f6-b2f5-f88fe227ca5c'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:05:29.898484 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5fd967dc-2333-4508-9e4f-104ea8b6a4d7 req-58d2c62b-a531-4c3a-bf1f-06fb408db12a tempest-TaggedBootDevicesTest-776080868 None] attachment_update completed successfully.
Apr 02 21:05:35.351538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da req-35bcccc6-9b52-4091-ad65-d339a3755436 tempest-AttachVolumeShelveTestJSON-1397899499 None] No connector for attachment ec179c4e-bb7e-499d-b83e-a2159fb5e976; skipping storage backend terminate_connection call. {{(pid=129783) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4908}}
Apr 02 21:05:35.352189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c27e0c5c-acf2-41e7-bdf0-6b018f6d71da req-35bcccc6-9b52-4091-ad65-d339a3755436 tempest-AttachVolumeShelveTestJSON-1397899499 None] Deleting attachment ec179c4e-bb7e-499d-b83e-a2159fb5e976. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:05:46.629338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:05:46.676740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (e53ee71e-1e25-4d85-b7fd-529db7ece05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:46.686986 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a229cf-bb22-4d58-b119-c6305ecfa36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.727843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a229cf-bb22-4d58-b119-c6305ecfa36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2098888247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=53932f9c-8a1a-44d4-851d-4805a7def1fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb31a4915e1341839e229bc3786bb4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:05:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:05:47Z,use_quota=True,user_id='2fed8f5059c44a8fa1a9526e81fa73e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.734035 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782ac121-9b58-44e0-a3be-178b8a534c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.742806 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782ac121-9b58-44e0-a3be-178b8a534c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.749957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c4e1fe-c0f5-4777-b4b8-c1cff6fbd2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.755068 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c4e1fe-c0f5-4777-b4b8-c1cff6fbd2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53932f9c-8a1a-44d4-851d-4805a7def1fe', 'volume_name': 'volume-53932f9c-8a1a-44d4-851d-4805a7def1fe', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.764848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c02eb9-5c11-4007-9a68-10ac5432fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.772730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c02eb9-5c11-4007-9a68-10ac5432fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.780917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e61d36-6e79-43d5-90b8-9c8090025d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.783011 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Volume 53932f9c-8a1a-44d4-851d-4805a7def1fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53932f9c-8a1a-44d4-851d-4805a7def1fe', 'volume_size': 1}
Apr 02 21:05:46.784216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] creating volume 'volume-53932f9c-8a1a-44d4-851d-4805a7def1fe' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:05:46.785813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:05:46.918129 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:05:46.918572 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:05:46.922851 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e61d36-6e79-43d5-90b8-9c8090025d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53932f9c-8a1a-44d4-851d-4805a7def1fe', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.933916 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acb62cb-7e09-477b-a033-646f57ca8abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:05:46.950350 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-53932f9c-8a1a-44d4-851d-4805a7def1fe (53932f9c-8a1a-44d4-851d-4805a7def1fe): created successfully
Apr 02 21:05:46.957503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acb62cb-7e09-477b-a033-646f57ca8abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:05:46.971961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (e53ee71e-1e25-4d85-b7fd-529db7ece05c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:05:46.994448 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8d6718b2-19ed-4005-aa05-064a001e5596 tempest-AttachVolumeNegativeTest-1037508314 None] Created volume successfully.
Apr 02 21:05:48.745102 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-326328cc-4d29-4f42-b30f-0e1ae11d8281 req-d880f714-8fdb-4a13-ab58-2d596cb97a99 tempest-AttachVolumeNegativeTest-1037508314 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:05:50.532610 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-326328cc-4d29-4f42-b30f-0e1ae11d8281 req-d880f714-8fdb-4a13-ab58-2d596cb97a99 tempest-AttachVolumeNegativeTest-1037508314 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.788s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:05:50.533440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-326328cc-4d29-4f42-b30f-0e1ae11d8281 req-d880f714-8fdb-4a13-ab58-2d596cb97a99 tempest-AttachVolumeNegativeTest-1037508314 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53932f9c-8a1a-44d4-851d-4805a7def1fe', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '53932f9c-8a1a-44d4-851d-4805a7def1fe', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:05:50.573868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-326328cc-4d29-4f42-b30f-0e1ae11d8281 req-d880f714-8fdb-4a13-ab58-2d596cb97a99 tempest-AttachVolumeNegativeTest-1037508314 None] Connection info returned from driver {'name': 'volumes/volume-53932f9c-8a1a-44d4-851d-4805a7def1fe', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '53932f9c-8a1a-44d4-851d-4805a7def1fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '94edfe21-cdf0-475f-b059-5828b7d4e2a0'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:05:50.672413 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-326328cc-4d29-4f42-b30f-0e1ae11d8281 req-d880f714-8fdb-4a13-ab58-2d596cb97a99 tempest-AttachVolumeNegativeTest-1037508314 None] attachment_update completed successfully.
Apr 02 21:06:11.528557 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:06:11.570775 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (948f17c2-6e87-4e99-853a-f7abeca6766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:11.584920 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8e671a-4fec-4c49-9643-ffdd57974fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:11.605109 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8e671a-4fec-4c49-9643-ffdd57974fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1223003790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2391b2a9-e519-4491-b2dd-b9c8719a7a94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76098fb9c22b4f84bb0afb2bbe66e858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:06:11Z,use_quota=True,user_id='e5d1c36098a14436a0a10f4fb9937bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:11.617541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710ac2e-a13b-4362-a728-8edfe9816d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:11.628572 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710ac2e-a13b-4362-a728-8edfe9816d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:11.635150 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ba018-8ab0-4327-af4b-7079f1619b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:11.762777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526ba018-8ab0-4327-af4b-7079f1619b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'volume_name': 'volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2955561c0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:11.767803 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a529f2-2e20-4eda-b6c7-83dd442e24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:11.773104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a529f2-2e20-4eda-b6c7-83dd442e24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:11.786567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56364b7a-6b19-40a3-b0f7-6f01d5467355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:11.787791 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Volume 2391b2a9-e519-4491-b2dd-b9c8719a7a94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2955561c0>}
Apr 02 21:06:11.788438 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Cloning 2391b2a9-e519-4491-b2dd-b9c8719a7a94 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:06:11.814019 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:06:11.834256 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 6, 11, 821600)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:06:11.834619 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:06:11.835030 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:06:11.842923 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.038s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:06:11.849728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:06:11.862191 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 6, 11, 856802)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:06:11.865065 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:06:11.866147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:06:11.889662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:06:12.002200 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] creating snapshot='volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:06:12.321153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94.clone_snap' to 'volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:06:12.548750 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:06:12.549796 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:06:12.550180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:06:12.587218 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:06:12.589412 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Marking volume 2391b2a9-e519-4491-b2dd-b9c8719a7a94 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:06:12.601973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 2391b2a9-e519-4491-b2dd-b9c8719a7a94. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:06:12.602778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Creating volume glance metadata for volume 2391b2a9-e519-4491-b2dd-b9c8719a7a94 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:06:12.703014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56364b7a-6b19-40a3-b0f7-6f01d5467355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2955561c0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:12.722435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f3b12-bd63-411f-a887-e76e3d92ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:12.734039 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94 (2391b2a9-e519-4491-b2dd-b9c8719a7a94): created successfully
Apr 02 21:06:12.745425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f3b12-bd63-411f-a887-e76e3d92ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:12.757970 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (948f17c2-6e87-4e99-853a-f7abeca6766b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:12.779961 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f22af86a-b689-4f7e-8657-f73fcec4c8f4 tempest-TaggedBootDevicesTest_v242-285856104 None] Created volume successfully.
Apr 02 21:06:14.346657 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:06:14.378032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (1e042c80-2d2c-46e2-a01f-799bf6a2db32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:14.387423 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaf25f9-76ac-49dd-98d8-9eff328cc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.411538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaf25f9-76ac-49dd-98d8-9eff328cc407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1526378781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9dd7dd0d-7620-4ade-ae79-7c552f2cc060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76098fb9c22b4f84bb0afb2bbe66e858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:06:14Z,use_quota=True,user_id='e5d1c36098a14436a0a10f4fb9937bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.419480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0c6fa9-1391-49f8-8187-e9d222cb1b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.458800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0c6fa9-1391-49f8-8187-e9d222cb1b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.482352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65f250d-3f01-4834-9f3c-bd139950a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.495925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65f250d-3f01-4834-9f3c-bd139950a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'volume_name': 'volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.506041 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b223ab89-000d-492d-b8ca-f00126c47710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.523736 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b223ab89-000d-492d-b8ca-f00126c47710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.534235 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1a1003-4c0d-424f-8049-3a4c1dca8d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.538256 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume 9dd7dd0d-7620-4ade-ae79-7c552f2cc060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'volume_size': 1}
Apr 02 21:06:14.539082 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] creating volume 'volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:06:14.540101 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:06:14.686680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:06:14.687122 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:06:14.691780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1a1003-4c0d-424f-8049-3a4c1dca8d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.699926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459648cb-299e-46e5-afd0-825d631684bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:14.721923 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060 (9dd7dd0d-7620-4ade-ae79-7c552f2cc060): created successfully
Apr 02 21:06:14.728805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459648cb-299e-46e5-afd0-825d631684bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:14.740207 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (1e042c80-2d2c-46e2-a01f-799bf6a2db32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:14.769293 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-654cc564-41fd-4feb-b906-39303ea6904b tempest-TaggedBootDevicesTest_v242-285856104 None] Created volume successfully.
Apr 02 21:06:16.224899 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:06:16.256544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (a3db3170-7064-478f-b324-f5d653085f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:16.266398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69abacaf-0b42-4c77-81f6-67f74aa95b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.327435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69abacaf-0b42-4c77-81f6-67f74aa95b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-232011746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbf32828-fb67-44ff-90ac-f60db7ea410b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76098fb9c22b4f84bb0afb2bbe66e858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:06:16Z,use_quota=True,user_id='e5d1c36098a14436a0a10f4fb9937bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.344406 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d160f7d-35a7-49bd-871f-aca75e3e09eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.357093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d160f7d-35a7-49bd-871f-aca75e3e09eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.368788 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6022820a-b44a-4f26-b0e5-712a80f10928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.383164 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6022820a-b44a-4f26-b0e5-712a80f10928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf32828-fb67-44ff-90ac-f60db7ea410b', 'volume_name': 'volume-fbf32828-fb67-44ff-90ac-f60db7ea410b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.393704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d38310-b6d7-43a4-a6d0-6e662816b616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.401188 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d38310-b6d7-43a4-a6d0-6e662816b616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.412712 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebab57-04db-4057-b482-3b3d16dd9dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.414445 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume fbf32828-fb67-44ff-90ac-f60db7ea410b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf32828-fb67-44ff-90ac-f60db7ea410b', 'volume_size': 1}
Apr 02 21:06:16.415881 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] creating volume 'volume-fbf32828-fb67-44ff-90ac-f60db7ea410b' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:06:16.417887 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:06:16.630402 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:06:16.631077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:06:16.636244 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ebab57-04db-4057-b482-3b3d16dd9dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf32828-fb67-44ff-90ac-f60db7ea410b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.645643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb63c3-fc62-4672-8b9e-b996ec0c3d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:06:16.678213 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-fbf32828-fb67-44ff-90ac-f60db7ea410b (fbf32828-fb67-44ff-90ac-f60db7ea410b): created successfully
Apr 02 21:06:16.685149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eb63c3-fc62-4672-8b9e-b996ec0c3d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:06:16.691691 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Flow 'volume_create_manager' (a3db3170-7064-478f-b324-f5d653085f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:06:16.708181 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0453e979-de75-4606-a7d1-7b0f96b6029b tempest-TaggedBootDevicesTest_v242-285856104 None] Created volume successfully.
Apr 02 21:06:28.815013 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:06:28.815013 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:06:28.893472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:06:28.950000 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:06:39.440072 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-a4a90808-90d5-4a32-a161-55be2a137544 tempest-TaggedBootDevicesTest_v242-285856104 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:06:40.197248 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-a4a90808-90d5-4a32-a161-55be2a137544 tempest-TaggedBootDevicesTest_v242-285856104 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.757s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:06:40.198161 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f442a8e-488a-415a-92e3-27de4974481d req-a4a90808-90d5-4a32-a161-55be2a137544 tempest-TaggedBootDevicesTest_v242-285856104 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:06:40.222700 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-a4a90808-90d5-4a32-a161-55be2a137544 tempest-TaggedBootDevicesTest_v242-285856104 None] Connection info returned from driver {'name': 'volumes/volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2391b2a9-e519-4491-b2dd-b9c8719a7a94', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0504f853-7085-46c5-8d3d-60dff6b53f0a'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:06:40.288618 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-a4a90808-90d5-4a32-a161-55be2a137544 tempest-TaggedBootDevicesTest_v242-285856104 None] attachment_update completed successfully.
Apr 02 21:06:40.638290 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-fe6e7e7d-a761-4b2d-96f0-b253e45ff47c tempest-TaggedBootDevicesTest_v242-285856104 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:06:41.466203 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-fe6e7e7d-a761-4b2d-96f0-b253e45ff47c tempest-TaggedBootDevicesTest_v242-285856104 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.828s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:06:41.467139 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f442a8e-488a-415a-92e3-27de4974481d req-fe6e7e7d-a761-4b2d-96f0-b253e45ff47c tempest-TaggedBootDevicesTest_v242-285856104 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:06:41.493774 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-fe6e7e7d-a761-4b2d-96f0-b253e45ff47c tempest-TaggedBootDevicesTest_v242-285856104 None] Connection info returned from driver {'name': 'volumes/volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9dd7dd0d-7620-4ade-ae79-7c552f2cc060', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2baff3c5-5a56-470b-a068-82531e080c59'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:06:41.541935 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-fe6e7e7d-a761-4b2d-96f0-b253e45ff47c tempest-TaggedBootDevicesTest_v242-285856104 None] attachment_update completed successfully.
Apr 02 21:06:41.998031 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-ad5c974e-5be6-49aa-bbbf-ae95de1dcb5e tempest-TaggedBootDevicesTest_v242-285856104 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:06:42.765774 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f442a8e-488a-415a-92e3-27de4974481d req-ad5c974e-5be6-49aa-bbbf-ae95de1dcb5e tempest-TaggedBootDevicesTest_v242-285856104 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.766s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:06:42.766579 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f442a8e-488a-415a-92e3-27de4974481d req-ad5c974e-5be6-49aa-bbbf-ae95de1dcb5e tempest-TaggedBootDevicesTest_v242-285856104 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fbf32828-fb67-44ff-90ac-f60db7ea410b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'fbf32828-fb67-44ff-90ac-f60db7ea410b', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:06:42.853431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-ad5c974e-5be6-49aa-bbbf-ae95de1dcb5e tempest-TaggedBootDevicesTest_v242-285856104 None] Connection info returned from driver {'name': 'volumes/volume-fbf32828-fb67-44ff-90ac-f60db7ea410b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fbf32828-fb67-44ff-90ac-f60db7ea410b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9f96ade6-0f0a-4f2b-8bf0-3799b92c77e5'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:06:42.951137 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3f442a8e-488a-415a-92e3-27de4974481d req-ad5c974e-5be6-49aa-bbbf-ae95de1dcb5e tempest-TaggedBootDevicesTest_v242-285856104 None] attachment_update completed successfully.
Apr 02 21:07:12.506940 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:07:12.527495 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Flow 'volume_create_manager' (f1fc137b-4ba1-4bb2-a6ad-a49999fa8c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:07:12.535575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19937176-c20a-43e8-91f6-8c83cf8375cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.552864 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19937176-c20a-43e8-91f6-8c83cf8375cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:07:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-854013994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=29e49b0d-456b-48c3-80fb-46117f085d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7469c380ae4cd2ae0028b72695e138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:07:12Z,use_quota=True,user_id='5ea5462daff849be91d24e869f5af732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d837188-61b4-4959-a779-9196490cf069),volume_type_id=8d837188-61b4-4959-a779-9196490cf069)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.559261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d10f2d-f1c5-45fa-aa11-70d49568c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.563624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d10f2d-f1c5-45fa-aa11-70d49568c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.569656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a2d0eb-34a5-460e-b771-1c9794005798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.573932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a2d0eb-34a5-460e-b771-1c9794005798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e49b0d-456b-48c3-80fb-46117f085d45', 'volume_name': 'volume-29e49b0d-456b-48c3-80fb-46117f085d45', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.579148 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93100420-8f11-4f98-9d59-5fe4fac06e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.583334 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93100420-8f11-4f98-9d59-5fe4fac06e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.588441 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9692e51-3b1c-470f-9588-bfbc89e3aa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.589549 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Volume 29e49b0d-456b-48c3-80fb-46117f085d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e49b0d-456b-48c3-80fb-46117f085d45', 'volume_size': 1}
Apr 02 21:07:12.589995 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] creating volume 'volume-29e49b0d-456b-48c3-80fb-46117f085d45' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:07:12.590829 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:12.656055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:07:12.656440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:07:12.660185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9692e51-3b1c-470f-9588-bfbc89e3aa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e49b0d-456b-48c3-80fb-46117f085d45', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.665369 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410e8f5-2cfc-4b5e-b355-2e8620425bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:12.674167 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Volume volume-29e49b0d-456b-48c3-80fb-46117f085d45 (29e49b0d-456b-48c3-80fb-46117f085d45): created successfully
Apr 02 21:07:12.677887 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410e8f5-2cfc-4b5e-b355-2e8620425bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:12.684163 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Flow 'volume_create_manager' (f1fc137b-4ba1-4bb2-a6ad-a49999fa8c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:07:12.692674 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-badcba38-3181-4af0-88d8-63ba95a42910 tempest-VolumeTypesTest-1217148838 None] Created volume successfully.
Apr 02 21:07:13.831509 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b5b29fb-9da3-4c55-b2ec-79cb5cd60fa0 tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:13.859473 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b5b29fb-9da3-4c55-b2ec-79cb5cd60fa0 tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:13.886780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-9b5b29fb-9da3-4c55-b2ec-79cb5cd60fa0 tempest-VolumeTypesTest-1217148838 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:07:13.891515 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9b5b29fb-9da3-4c55-b2ec-79cb5cd60fa0 tempest-VolumeTypesTest-1217148838 None] Retype volume completed successfully.
Apr 02 21:07:15.909547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Lock "b'cinder-29e49b0d-456b-48c3-80fb-46117f085d45-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:07:15.962818 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:16.049491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:07:16.051653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Volume volume-29e49b0d-456b-48c3-80fb-46117f085d45 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:07:16.067214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] deleting rbd volume volume-29e49b0d-456b-48c3-80fb-46117f085d45 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:07:16.485852 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1492673521 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1492673521, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:07:16.487027 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1492673521 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1492673521, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:07:16.514335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Created reservations ['adeaee18-16fc-4ef1-af2e-c85d204a6e77', '9548ec7a-d0ce-4e39-b6ac-6b64e0844292', '3fc58fb0-0e6c-4330-a2a8-be3d371e3cd7', 'a58f92cc-2bad-433d-a84a-768b0376dafc'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:07:16.562404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:16.609096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:16.642410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:07:16.647975 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Deleted volume successfully.
Apr 02 21:07:16.665151 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e95a6fe7-bc04-4a08-9a88-e7441e31d66d tempest-VolumeTypesTest-1217148838 None] Lock "b'cinder-29e49b0d-456b-48c3-80fb-46117f085d45-delete_volume'" released by "delete_volume" :: held 0.756s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:07:18.937005 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Lock "b'cinder-1e69b880-61ea-4a88-8197-f35a7b853345-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:07:18.973097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:19.020820 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:07:19.022849 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume volume-1e69b880-61ea-4a88-8197-f35a7b853345 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:07:19.029149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] deleting rbd volume volume-1e69b880-61ea-4a88-8197-f35a7b853345 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:07:19.374474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Created reservations ['823ace2b-1519-4926-98d1-7c40ed210126', 'fae36a28-f336-4a6c-b523-9abc8b20216c', '949e8cea-a635-4840-ad7f-4e49c45a5435', '7f92cf82-2cb4-452f-abb5-fca388e9b732'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:07:19.435675 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:19.467983 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:19.515232 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:07:19.519549 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Deleted volume successfully.
Apr 02 21:07:19.536169 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-746e5f22-9045-449d-bb41-6d72e1d00137 tempest-AttachVolumeShelveTestJSON-1397899499 None] Lock "b'cinder-1e69b880-61ea-4a88-8197-f35a7b853345-delete_volume'" released by "delete_volume" :: held 0.600s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:07:20.153616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Lock "b'cinder-35aae13b-58e7-47bc-9a5c-0ca232ff5912-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:07:20.199069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:20.249444 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:07:20.249891 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Volume volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:07:20.256676 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] deleting rbd volume volume-35aae13b-58e7-47bc-9a5c-0ca232ff5912 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:07:20.592079 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Created reservations ['62908767-2488-482d-991f-032748669d8b', '1173aef0-9371-4e00-963c-eb77faec373b', '42b76eff-a1cb-4116-9a33-e18341a8ea22', '556acd4c-355d-4eef-bedf-fe3a3744140e'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:07:20.645930 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:20.700810 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:20.763589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:07:20.769685 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Deleted volume successfully.
Apr 02 21:07:20.784045 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d2eb703f-f94b-49ee-b6bc-1d2a63b4d44b tempest-AttachVolumeShelveTestJSON-1397899499 None] Lock "b'cinder-35aae13b-58e7-47bc-9a5c-0ca232ff5912-delete_volume'" released by "delete_volume" :: held 0.631s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:07:27.631148 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:07:27.657171 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Flow 'volume_create_manager' (37e8f994-e887-4db5-af65-6b17786c9e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:07:27.666451 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeb307f-a0d7-4239-9bc7-558cd89c4e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.684364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeb307f-a0d7-4239-9bc7-558cd89c4e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1867359665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=44beae3a-85d1-4e0e-a33a-3b6a39728889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54b2160309b4d76bd7a944454903520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:07:28Z,use_quota=True,user_id='d12e43a0a2994654a400b3a2bed83ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.690298 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28d9b74-9a26-4d6e-9952-ba6783f1d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.696751 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28d9b74-9a26-4d6e-9952-ba6783f1d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.702461 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1dafe8-558a-471b-b283-82c5e28f7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.706949 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1dafe8-558a-471b-b283-82c5e28f7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44beae3a-85d1-4e0e-a33a-3b6a39728889', 'volume_name': 'volume-44beae3a-85d1-4e0e-a33a-3b6a39728889', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.713318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be3125-2e41-42d8-a0a9-51dd9d520bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.718152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57be3125-2e41-42d8-a0a9-51dd9d520bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.723788 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f51831b-c96d-4e15-83a1-24ce4e35b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.725129 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Volume 44beae3a-85d1-4e0e-a33a-3b6a39728889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44beae3a-85d1-4e0e-a33a-3b6a39728889', 'volume_size': 1}
Apr 02 21:07:27.725593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] creating volume 'volume-44beae3a-85d1-4e0e-a33a-3b6a39728889' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:07:27.726608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:27.802909 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:07:27.803392 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:07:27.808935 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f51831b-c96d-4e15-83a1-24ce4e35b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44beae3a-85d1-4e0e-a33a-3b6a39728889', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.814312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc22496-e106-4cd4-8357-f224a256efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:07:27.827398 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Volume volume-44beae3a-85d1-4e0e-a33a-3b6a39728889 (44beae3a-85d1-4e0e-a33a-3b6a39728889): created successfully
Apr 02 21:07:27.832955 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc22496-e106-4cd4-8357-f224a256efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:07:27.839651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Flow 'volume_create_manager' (37e8f994-e887-4db5-af65-6b17786c9e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:07:27.850455 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b669ddcb-7353-432c-a354-1a0c39ddaee5 tempest-VolumesActionsTest-1651102816 None] Created volume successfully.
Apr 02 21:07:28.816269 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:07:28.817030 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:28.873193 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:07:28.916363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:07:44.043285 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 req-ead59835-2710-487b-8588-276169cb0c7a tempest-AttachVolumeNegativeTest-1037508314 None] Terminate volume connection completed successfully.
Apr 02 21:07:44.044826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-0e4c7e1f-a7ff-4bec-8fe0-1a3b831d3e21 req-ead59835-2710-487b-8588-276169cb0c7a tempest-AttachVolumeNegativeTest-1037508314 None] Deleting attachment 94edfe21-cdf0-475f-b059-5828b7d4e2a0. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:07:44.502250 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4305d8bd-172d-4326-acf7-a6eea66de8b2 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889'" acquired by "attach_volume" :: waited 0.033s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:07:44.578818 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4305d8bd-172d-4326-acf7-a6eea66de8b2 tempest-VolumesActionsTest-1651102816 None] Attaching volume 44beae3a-85d1-4e0e-a33a-3b6a39728889 to instance 64af2333-6bd9-4659-b79a-3514e9b221ea at mountpoint /dev/sdb on host None.
Apr 02 21:07:44.631504 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4305d8bd-172d-4326-acf7-a6eea66de8b2 tempest-VolumesActionsTest-1651102816 None] Attach volume completed successfully.
Apr 02 21:07:44.637947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4305d8bd-172d-4326-acf7-a6eea66de8b2 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889'" released by "attach_volume" :: held 0.135s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:07:44.828093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0c56bb99-0568-4290-8e65-988f83d9f02f tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-detach_volume'" acquired by "detach_volume" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:07:44.829805 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0c56bb99-0568-4290-8e65-988f83d9f02f tempest-VolumesActionsTest-1651102816 None] Detaching volume 44beae3a-85d1-4e0e-a33a-3b6a39728889 from instance 64af2333-6bd9-4659-b79a-3514e9b221ea.
Apr 02 21:07:44.907299 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0c56bb99-0568-4290-8e65-988f83d9f02f tempest-VolumesActionsTest-1651102816 None] Detach volume completed successfully.
Apr 02 21:07:44.915944 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0c56bb99-0568-4290-8e65-988f83d9f02f tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-detach_volume'" released by "detach_volume" :: held 0.088s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:08.014512 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0d969ca7-61bf-4e11-8f10-1630e6660d24 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889'" acquired by "attach_volume" :: waited 0.026s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:08.069401 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0d969ca7-61bf-4e11-8f10-1630e6660d24 tempest-VolumesActionsTest-1651102816 None] Attaching volume 44beae3a-85d1-4e0e-a33a-3b6a39728889 to instance 208b3d58-e40e-4350-9f4d-0e979db4cadc at mountpoint /dev/sdb on host None.
Apr 02 21:08:08.103079 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0d969ca7-61bf-4e11-8f10-1630e6660d24 tempest-VolumesActionsTest-1651102816 None] Attach volume completed successfully.
Apr 02 21:08:08.111801 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0d969ca7-61bf-4e11-8f10-1630e6660d24 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889'" released by "attach_volume" :: held 0.097s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:08.323565 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bb3c3cc4-ce7a-4d30-90ba-2a34a82a20f0 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-detach_volume'" acquired by "detach_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:08.324720 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bb3c3cc4-ce7a-4d30-90ba-2a34a82a20f0 tempest-VolumesActionsTest-1651102816 None] Detaching volume 44beae3a-85d1-4e0e-a33a-3b6a39728889 from instance 208b3d58-e40e-4350-9f4d-0e979db4cadc.
Apr 02 21:08:08.367438 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bb3c3cc4-ce7a-4d30-90ba-2a34a82a20f0 tempest-VolumesActionsTest-1651102816 None] Detach volume completed successfully.
Apr 02 21:08:08.373419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bb3c3cc4-ce7a-4d30-90ba-2a34a82a20f0 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-detach_volume'" released by "detach_volume" :: held 0.050s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:13.686420 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-f7b8d8f3-d6be-4da2-b2da-3548c69122d6 tempest-VolumesActionsTest-1651102816 None] Running cmd (subprocess): rbd export --pool volumes volume-44beae3a-85d1-4e0e-a33a-3b6a39728889 /opt/stack/data/cinder/conversion/volume-44beae3a-85d1-4e0e-a33a-3b6a39728889-8d649a52-44ee-4c5f-84b6-5e8cfe18dd33 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:08:14.579187 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-f7b8d8f3-d6be-4da2-b2da-3548c69122d6 tempest-VolumesActionsTest-1651102816 None] CMD "rbd export --pool volumes volume-44beae3a-85d1-4e0e-a33a-3b6a39728889 /opt/stack/data/cinder/conversion/volume-44beae3a-85d1-4e0e-a33a-3b6a39728889-8d649a52-44ee-4c5f-84b6-5e8cfe18dd33 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:08:14.594402 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.image_utils [None req-f7b8d8f3-d6be-4da2-b2da-3548c69122d6 tempest-VolumesActionsTest-1651102816 None] 8d649a52-44ee-4c5f-84b6-5e8cfe18dd33 was raw, no need to convert to raw {{(pid=129783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}}
Apr 02 21:08:28.813613 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:08:28.815590 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:28.864773 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:28.937140 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:08:42.307703 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f7b8d8f3-d6be-4da2-b2da-3548c69122d6 tempest-VolumesActionsTest-1651102816 None] Uploaded volume to glance image-id: 8d649a52-44ee-4c5f-84b6-5e8cfe18dd33. {{(pid=129783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1745}}
Apr 02 21:08:42.335459 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f7b8d8f3-d6be-4da2-b2da-3548c69122d6 tempest-VolumesActionsTest-1651102816 None] Copy volume to image completed successfully.
Apr 02 21:08:44.084875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:44.145710 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:44.248067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:08:44.249351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Volume volume-44beae3a-85d1-4e0e-a33a-3b6a39728889 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:08:44.266153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] deleting rbd volume volume-44beae3a-85d1-4e0e-a33a-3b6a39728889 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:08:44.885100 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Created reservations ['ef97b370-f418-46a1-8ded-5ced4123a6cf', 'd8104eb0-87f2-4e15-b32c-905a545fa07c', '6820421b-dc4b-4d0a-8555-7c29ea837e4d', 'fb38bf33-fc7b-4f68-8e0f-9b7f090a91c7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:08:44.998054 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:45.092545 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:45.162558 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:08:45.167862 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Deleted volume successfully.
Apr 02 21:08:45.191352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-6b5b206c-f5cf-47bf-841f-f1d78c12bdf0 tempest-VolumesActionsTest-1651102816 None] Lock "b'cinder-44beae3a-85d1-4e0e-a33a-3b6a39728889-delete_volume'" released by "delete_volume" :: held 1.106s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:49.102024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:08:49.124231 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (2c3add40-4435-47a0-bde2-d3cdcc9ec451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:49.132226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36290101-98e0-4bba-902b-532d28640854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.152299 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36290101-98e0-4bba-902b-532d28640854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-920072127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=39556342-fa9d-4e08-a209-bbbdbdea14e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2442029388874d1a9e68e31f444d718a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:08:49Z,use_quota=True,user_id='2aebce92aa0b4b9b97a930bfb53fc981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.159606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2be92c-05ac-48f7-8ede-b70a6fa9cc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.165021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2be92c-05ac-48f7-8ede-b70a6fa9cc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.170972 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8330704f-fbe2-44d3-8db7-62bf190f115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.175880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8330704f-fbe2-44d3-8db7-62bf190f115a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39556342-fa9d-4e08-a209-bbbdbdea14e4', 'volume_name': 'volume-39556342-fa9d-4e08-a209-bbbdbdea14e4', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.181405 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155f06a-573d-4bf0-95f1-523ac92f1920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.185776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155f06a-573d-4bf0-95f1-523ac92f1920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.191901 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cedf5a-039b-4444-8d28-a6dbf2e6caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.193372 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Volume 39556342-fa9d-4e08-a209-bbbdbdea14e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39556342-fa9d-4e08-a209-bbbdbdea14e4', 'volume_size': 1}
Apr 02 21:08:49.194055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] creating volume 'volume-39556342-fa9d-4e08-a209-bbbdbdea14e4' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:08:49.195019 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:49.311588 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:08:49.312789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:08:49.319022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cedf5a-039b-4444-8d28-a6dbf2e6caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39556342-fa9d-4e08-a209-bbbdbdea14e4', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.334803 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c944b-eb8a-4085-a344-4e820fd58e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:49.350837 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Volume volume-39556342-fa9d-4e08-a209-bbbdbdea14e4 (39556342-fa9d-4e08-a209-bbbdbdea14e4): created successfully
Apr 02 21:08:49.358074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96c944b-eb8a-4085-a344-4e820fd58e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:49.369164 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (2c3add40-4435-47a0-bde2-d3cdcc9ec451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:49.384739 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-dc2e0c01-f6da-40fb-ad13-d89dd7d3cc01 tempest-VolumesListTestJSON-1557689976 None] Created volume successfully.
Apr 02 21:08:50.951023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:08:50.994980 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (ca1977b6-d048-483a-a295-519dcfb9bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:51.009613 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a102162-6270-4f3d-9f21-89db2ebd1d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.059249 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a102162-6270-4f3d-9f21-89db2ebd1d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1977549998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=23161138-90a8-4ef1-b261-002ba3d275fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2442029388874d1a9e68e31f444d718a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:08:51Z,use_quota=True,user_id='2aebce92aa0b4b9b97a930bfb53fc981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.069607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bd21da-6a33-4244-81eb-d9c0ae0c79e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.076686 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bd21da-6a33-4244-81eb-d9c0ae0c79e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.086468 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f223817-4a9e-45ce-a993-53aca2469607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.091349 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f223817-4a9e-45ce-a993-53aca2469607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23161138-90a8-4ef1-b261-002ba3d275fe', 'volume_name': 'volume-23161138-90a8-4ef1-b261-002ba3d275fe', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.098314 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ebfd10-41e1-4362-a772-2cf488f5d785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.106670 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ebfd10-41e1-4362-a772-2cf488f5d785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.113361 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a61db43-e736-4f7c-a55a-4e4b1f865e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.114880 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Volume 23161138-90a8-4ef1-b261-002ba3d275fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23161138-90a8-4ef1-b261-002ba3d275fe', 'volume_size': 1}
Apr 02 21:08:51.115659 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] creating volume 'volume-23161138-90a8-4ef1-b261-002ba3d275fe' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:08:51.116777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:51.289547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:08:51.290199 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:08:51.294418 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a61db43-e736-4f7c-a55a-4e4b1f865e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23161138-90a8-4ef1-b261-002ba3d275fe', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.299589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6091d2c8-d5e0-434a-a946-4543c043255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:51.312550 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Volume volume-23161138-90a8-4ef1-b261-002ba3d275fe (23161138-90a8-4ef1-b261-002ba3d275fe): created successfully
Apr 02 21:08:51.318301 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6091d2c8-d5e0-434a-a946-4543c043255c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:51.327409 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (ca1977b6-d048-483a-a295-519dcfb9bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:51.340982 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-88968815-0457-4a09-8c56-d9b75491f1ae tempest-VolumesListTestJSON-1557689976 None] Created volume successfully.
Apr 02 21:08:52.459813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:08:52.489001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (344298b2-21e2-4120-89b6-2978dfd74cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:52.496201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9922f6f2-fef5-49d3-b9f0-c6457866f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.521101 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9922f6f2-fef5-49d3-b9f0-c6457866f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1398939963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=41436b37-eb60-4a7a-8df5-38b930a50891,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2442029388874d1a9e68e31f444d718a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:08:52Z,use_quota=True,user_id='2aebce92aa0b4b9b97a930bfb53fc981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.529734 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211ea0b8-99fd-49e6-b0d7-c050879f9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.535706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211ea0b8-99fd-49e6-b0d7-c050879f9091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.541630 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c87de1-733c-43df-b458-eeb4555158a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.546380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c87de1-733c-43df-b458-eeb4555158a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41436b37-eb60-4a7a-8df5-38b930a50891', 'volume_name': 'volume-41436b37-eb60-4a7a-8df5-38b930a50891', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.552906 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a9ba30-397e-4cba-8a6c-4bbc9209f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.557489 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a9ba30-397e-4cba-8a6c-4bbc9209f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.563228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1815079-e242-4787-a48c-678712f4d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.564553 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Volume 41436b37-eb60-4a7a-8df5-38b930a50891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41436b37-eb60-4a7a-8df5-38b930a50891', 'volume_size': 1}
Apr 02 21:08:52.565076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] creating volume 'volume-41436b37-eb60-4a7a-8df5-38b930a50891' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:08:52.565914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:52.633133 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:08:52.633914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:08:52.638745 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1815079-e242-4787-a48c-678712f4d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41436b37-eb60-4a7a-8df5-38b930a50891', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.644904 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef9ecfa-d2c0-433b-be63-16c9ba275a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:52.654268 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Volume volume-41436b37-eb60-4a7a-8df5-38b930a50891 (41436b37-eb60-4a7a-8df5-38b930a50891): created successfully
Apr 02 21:08:52.658923 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef9ecfa-d2c0-433b-be63-16c9ba275a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:52.665706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Flow 'volume_create_manager' (344298b2-21e2-4120-89b6-2978dfd74cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:52.674779 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-aaf4b843-672b-4e38-8188-f2751595ca4f tempest-VolumesListTestJSON-1557689976 None] Created volume successfully.
Apr 02 21:08:56.612271 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:08:56.635064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (4c214423-95cd-4558-a615-c6d0603ce79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:56.642951 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4656add-69e8-41cf-b2a4-1b9031c33315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.663637 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4656add-69e8-41cf-b2a4-1b9031c33315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-627603302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=696f5abc-2112-4bfb-bb0e-51027fe32d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb31a4915e1341839e229bc3786bb4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:08:57Z,use_quota=True,user_id='2fed8f5059c44a8fa1a9526e81fa73e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.669267 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b813336-e05c-4ef1-80a5-ff5c520c1692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.674071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b813336-e05c-4ef1-80a5-ff5c520c1692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.679420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfa7568-abf5-478a-ad08-f047f4dcc314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.683528 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfa7568-abf5-478a-ad08-f047f4dcc314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'volume_name': 'volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.688927 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5204fd7-b8c8-46fe-b4e1-d4be42335ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.693533 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5204fd7-b8c8-46fe-b4e1-d4be42335ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.698486 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600b42f-f799-4817-9249-fc7bae3ff77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.699569 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Volume 696f5abc-2112-4bfb-bb0e-51027fe32d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'volume_size': 1}
Apr 02 21:08:56.699963 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] creating volume 'volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:08:56.700865 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:56.742367 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-41436b37-eb60-4a7a-8df5-38b930a50891-delete_volume'" acquired by "delete_volume" :: waited 0.135s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:56.789409 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:56.849182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:08:56.849708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Volume volume-41436b37-eb60-4a7a-8df5-38b930a50891 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:08:56.855635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] deleting rbd volume volume-41436b37-eb60-4a7a-8df5-38b930a50891 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:08:56.864262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:08:56.864713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:08:56.869676 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600b42f-f799-4817-9249-fc7bae3ff77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.875238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c476925f-dc3c-4e74-b5b8-6874e9380482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:08:56.887736 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f (696f5abc-2112-4bfb-bb0e-51027fe32d7f): created successfully
Apr 02 21:08:56.892717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c476925f-dc3c-4e74-b5b8-6874e9380482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:08:56.900561 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (4c214423-95cd-4558-a615-c6d0603ce79d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:08:56.910296 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-30d9c909-128b-413c-881b-d14db1773a73 tempest-AttachVolumeNegativeTest-1037508314 None] Created volume successfully.
Apr 02 21:08:57.071714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Created reservations ['57393fb8-f712-4d0d-a38c-19970a9bd47e', 'e152f80c-2868-4e28-b413-ede466de37f5', 'af348e93-618d-482f-a42f-f1419660db2f', '6a3fe4a3-6ea1-4a77-ae76-d3e167768e3d'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:08:57.121215 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:57.157304 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:57.193345 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:08:57.198897 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Deleted volume successfully.
Apr 02 21:08:57.212636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7742ba0d-d716-4914-b6de-44c786f16a2f tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-41436b37-eb60-4a7a-8df5-38b930a50891-delete_volume'" released by "delete_volume" :: held 0.470s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:57.782372 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-23161138-90a8-4ef1-b261-002ba3d275fe-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:57.830241 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:57.884318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:08:57.884318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Volume volume-23161138-90a8-4ef1-b261-002ba3d275fe is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:08:57.894169 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] deleting rbd volume volume-23161138-90a8-4ef1-b261-002ba3d275fe {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:08:58.134445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Created reservations ['9ed50344-c94b-4409-972a-231fa1748e89', '2bba44ec-50a5-4594-823a-192521fd53b7', '140c7a66-a4db-4284-8987-1327369d0375', '5eba076b-5792-44a3-a576-e80aca8f43f7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:08:58.190414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:58.246543 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:58.292576 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:08:58.303496 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Deleted volume successfully.
Apr 02 21:08:58.316677 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-72cb8e96-6566-4172-aa63-990dca4f04bc req-4f331649-b7bf-47ca-b312-7cc687bae303 tempest-AttachVolumeNegativeTest-1037508314 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:08:58.342482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-94c08e21-f487-42b4-8293-90772f5dde6d tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-23161138-90a8-4ef1-b261-002ba3d275fe-delete_volume'" released by "delete_volume" :: held 0.560s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:08:59.023611 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-39556342-fa9d-4e08-a209-bbbdbdea14e4-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:08:59.107524 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:59.234510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:08:59.234963 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Volume volume-39556342-fa9d-4e08-a209-bbbdbdea14e4 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:08:59.245286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] deleting rbd volume volume-39556342-fa9d-4e08-a209-bbbdbdea14e4 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:08:59.254296 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-72cb8e96-6566-4172-aa63-990dca4f04bc req-4f331649-b7bf-47ca-b312-7cc687bae303 tempest-AttachVolumeNegativeTest-1037508314 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.937s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:08:59.255080 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-72cb8e96-6566-4172-aa63-990dca4f04bc req-4f331649-b7bf-47ca-b312-7cc687bae303 tempest-AttachVolumeNegativeTest-1037508314 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:08:59.294004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-72cb8e96-6566-4172-aa63-990dca4f04bc req-4f331649-b7bf-47ca-b312-7cc687bae303 tempest-AttachVolumeNegativeTest-1037508314 None] Connection info returned from driver {'name': 'volumes/volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '696f5abc-2112-4bfb-bb0e-51027fe32d7f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '920e6807-dd4b-4931-820c-e28b68743ecc'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:08:59.356866 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-72cb8e96-6566-4172-aa63-990dca4f04bc req-4f331649-b7bf-47ca-b312-7cc687bae303 tempest-AttachVolumeNegativeTest-1037508314 None] attachment_update completed successfully.
Apr 02 21:08:59.573961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Created reservations ['2d6f46fc-348f-46f6-873c-64c849fd059e', 'ba286b1f-9626-43f0-b120-5b4c2863c848', '9298d188-0cab-4578-a1c6-c6cc216ca42e', 'a04a9087-f2c6-476e-961b-8ec284d60e59'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:08:59.624056 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:59.671539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:08:59.726705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:08:59.733547 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Deleted volume successfully.
Apr 02 21:08:59.748440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c4d40856-ad9f-481c-80e9-a52d4f911130 tempest-VolumesListTestJSON-1557689976 None] Lock "b'cinder-39556342-fa9d-4e08-a209-bbbdbdea14e4-delete_volume'" released by "delete_volume" :: held 0.725s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:09:02.757093 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-9a51666b-2c31-41bf-a81d-8b5d3365e999 req-4c68389e-4ddd-4512-9946-dd9f7926da43 tempest-AttachVolumeNegativeTest-1037508314 None] Terminate volume connection completed successfully.
Apr 02 21:09:02.757831 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-9a51666b-2c31-41bf-a81d-8b5d3365e999 req-4c68389e-4ddd-4512-9946-dd9f7926da43 tempest-AttachVolumeNegativeTest-1037508314 None] Deleting attachment 920e6807-dd4b-4931-820c-e28b68743ecc. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:09:28.813058 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:09:28.813769 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:09:28.881729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:09:28.935514 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:09:56.827737 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-63f217fa-3e42-477e-b044-987cc93fb913 tempest-TaggedBootDevicesTest-776080868 None] Terminate volume connection completed successfully.
Apr 02 21:09:56.827737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-63f217fa-3e42-477e-b044-987cc93fb913 tempest-TaggedBootDevicesTest-776080868 None] Deleting attachment 6d30e13b-cdc8-4165-b725-b3b6cd7a92f0. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:09:57.019687 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-2c9cefb2-ddd1-46ec-aed7-9395efebfbf1 tempest-TaggedBootDevicesTest-776080868 None] Terminate volume connection completed successfully.
Apr 02 21:09:57.020582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-2c9cefb2-ddd1-46ec-aed7-9395efebfbf1 tempest-TaggedBootDevicesTest-776080868 None] Deleting attachment 47b18cd0-a91e-44ff-8bad-6730e79977cd. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:09:57.208892 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-f3fb31cc-bf84-4794-87bb-6bec70de8235 tempest-TaggedBootDevicesTest-776080868 None] Terminate volume connection completed successfully.
Apr 02 21:09:57.209592 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-c829ed02-e51d-4e76-a985-7ab2a876311d req-f3fb31cc-bf84-4794-87bb-6bec70de8235 tempest-TaggedBootDevicesTest-776080868 None] Deleting attachment b2de6f82-6a2e-47f6-b2f5-f88fe227ca5c. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:10:04.214967 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-353e1bda-2e9a-4abd-84bc-8d3fc2f65146-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:10:04.264088 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:04.337838 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:10:04.338692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Volume volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:10:04.356804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] deleting rbd volume volume-353e1bda-2e9a-4abd-84bc-8d3fc2f65146 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:10:04.668238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Created reservations ['51bc4c98-4da4-455c-8668-659977acb6cb', 'b1e7446a-67a1-475c-8481-b7a527895bef', 'f10b8b79-648c-4bb5-b645-34dec8f58b26', 'bc5c411c-9e47-4afe-8831-1a7e04068692'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:10:04.723781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:04.772073 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:04.819867 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:10:04.825615 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Deleted volume successfully.
Apr 02 21:10:04.839755 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-95c37edc-2089-4d07-a25a-76396fb71cfa tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-353e1bda-2e9a-4abd-84bc-8d3fc2f65146-delete_volume'" released by "delete_volume" :: held 0.627s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:10:05.390391 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-afc1ced9-2e41-456b-991e-0deebbfcdc27-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:10:05.434278 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:05.494294 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:10:05.494861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Volume volume-afc1ced9-2e41-456b-991e-0deebbfcdc27 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:10:05.507346 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] deleting rbd volume volume-afc1ced9-2e41-456b-991e-0deebbfcdc27 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:10:05.731340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Created reservations ['fb666198-f638-4fde-a146-1ee2d9232684', '34404b5a-e4f2-424a-b6d9-e141b6629069', 'bbce2489-ef16-459f-a19f-00938da769bb', 'd4cb958c-ce15-40cc-998f-6b70d63fd782'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:10:05.777632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:05.816223 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:05.851338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:10:05.855922 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Deleted volume successfully.
Apr 02 21:10:05.884173 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ce4254b1-6651-4b26-a4ea-971d8f3c142e tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-afc1ced9-2e41-456b-991e-0deebbfcdc27-delete_volume'" released by "delete_volume" :: held 0.494s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:10:06.574693 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-4745418f-c52c-437e-a1b1-9414ea2b7f8a-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:10:06.639871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:06.721416 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:10:06.731541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] deleting rbd volume volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:10:07.064118 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:10:07.111114 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] deleting parent snapshot volume-4745418f-c52c-437e-a1b1-9414ea2b7f8a.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:10:07.715339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] Created reservations ['e66657a3-8a45-4499-ba47-9f8f706fc21e', '3478128b-0a0f-4d47-a287-627163e02f86', '96a49b57-7961-4e62-af95-0b8d7e1478a2', '1e609513-3409-4ae1-804f-07f61c240398'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:10:07.759265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:07.804104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:07.840601 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:10:07.846440 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] Deleted volume successfully.
Apr 02 21:10:07.862161 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d0752a62-dcff-4d81-9194-9c1ca379bcd9 tempest-TaggedBootDevicesTest-776080868 None] Lock "b'cinder-4745418f-c52c-437e-a1b1-9414ea2b7f8a-delete_volume'" released by "delete_volume" :: held 1.288s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:10:28.808954 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:10:28.810701 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:28.907144 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:28.975772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:10:35.951550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:10:35.971935 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Flow 'volume_create_manager' (f227dc4c-32f8-48a8-8b8d-97f4aacf758e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:10:35.978955 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200cb9a7-64b7-4a81-b2b3-20c368a049a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:35.994453 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200cb9a7-64b7-4a81-b2b3-20c368a049a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1617505165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0a72472-a1aa-4b7e-a842-f0243245ada7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e9483710f0424b9c347c74a9da708a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:10:36Z,use_quota=True,user_id='d7ebf8694d674ee38bb5f58a3687a415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.000440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6d8570-60a0-46d0-b2c0-1740056e75cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:36.004593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6d8570-60a0-46d0-b2c0-1740056e75cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.009737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3e7fb9-a2e9-4cb8-ab95-af00667f8ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:36.014029 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3e7fb9-a2e9-4cb8-ab95-af00667f8ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a72472-a1aa-4b7e-a842-f0243245ada7', 'volume_name': 'volume-c0a72472-a1aa-4b7e-a842-f0243245ada7', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.019152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f82a5-ecd6-47b6-bcac-7e6b3b72dd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:36.023083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (989f82a5-ecd6-47b6-bcac-7e6b3b72dd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.027820 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c204f67-c029-4b1e-8ecd-fad697a837d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:36.028919 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume c0a72472-a1aa-4b7e-a842-f0243245ada7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a72472-a1aa-4b7e-a842-f0243245ada7', 'volume_size': 1}
Apr 02 21:10:36.029316 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] creating volume 'volume-c0a72472-a1aa-4b7e-a842-f0243245ada7' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:10:36.030097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:36.092280 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:10:36.092690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:10:36.096363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c204f67-c029-4b1e-8ecd-fad697a837d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a72472-a1aa-4b7e-a842-f0243245ada7', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.101074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc8032-2ede-413c-acc5-94970aa0a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:36.110855 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume volume-c0a72472-a1aa-4b7e-a842-f0243245ada7 (c0a72472-a1aa-4b7e-a842-f0243245ada7): created successfully
Apr 02 21:10:36.115487 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc8032-2ede-413c-acc5-94970aa0a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:36.121184 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Flow 'volume_create_manager' (f227dc4c-32f8-48a8-8b8d-97f4aacf758e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:10:36.130806 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-980e4f88-6064-4ecc-8085-d25720026451 tempest-ServerRescueNegativeTestJSON-1832764052 None] Created volume successfully.
Apr 02 21:10:54.487061 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:10:54.539458 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (845157d6-7cad-414f-a075-f18197a5bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:10:54.563739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017dc0ac-be24-4a60-a46e-02de25f381a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.607889 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (017dc0ac-be24-4a60-a46e-02de25f381a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-964500957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb31a4915e1341839e229bc3786bb4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:10:54Z,use_quota=True,user_id='2fed8f5059c44a8fa1a9526e81fa73e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.624227 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219a132a-f2c8-49d4-8721-43f0f5068913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.634595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (219a132a-f2c8-49d4-8721-43f0f5068913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.650869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24fc08e-0a33-46b5-9471-4400320ce6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.668877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24fc08e-0a33-46b5-9471-4400320ce6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'volume_name': 'volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.680709 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ebf16f-969a-417d-bba5-b7eba9133b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.692598 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ebf16f-969a-417d-bba5-b7eba9133b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.712770 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11e4568-e13d-4455-b8df-61a03d477c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.714078 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Volume 6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'volume_size': 1}
Apr 02 21:10:54.716439 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] creating volume 'volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:10:54.717379 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:10:54.919609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:10:54.920255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:10:54.925673 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11e4568-e13d-4455-b8df-61a03d477c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.931058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a42eb5-c898-44ca-aeef-184abc7bfbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:10:54.944809 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9 (6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9): created successfully
Apr 02 21:10:54.953727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8a42eb5-c898-44ca-aeef-184abc7bfbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:10:54.960259 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Flow 'volume_create_manager' (845157d6-7cad-414f-a075-f18197a5bc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:10:54.972253 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-25b3c66e-d0d1-4b71-8dc5-e2c7fcb57cb3 tempest-AttachVolumeNegativeTest-1037508314 None] Created volume successfully.
Apr 02 21:10:56.418269 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d req-5ab8fcfd-3804-41bd-bb98-de058150b78d tempest-AttachVolumeNegativeTest-1037508314 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:10:57.740226 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d req-5ab8fcfd-3804-41bd-bb98-de058150b78d tempest-AttachVolumeNegativeTest-1037508314 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.322s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:10:57.741501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d req-5ab8fcfd-3804-41bd-bb98-de058150b78d tempest-AttachVolumeNegativeTest-1037508314 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:10:57.799485 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d req-5ab8fcfd-3804-41bd-bb98-de058150b78d tempest-AttachVolumeNegativeTest-1037508314 None] Connection info returned from driver {'name': 'volumes/volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '006348c5-adb5-4a19-8326-e778279a69d4'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:10:57.940344 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-5d25db06-cbbc-45c6-bda1-3ad703b73c6d req-5ab8fcfd-3804-41bd-bb98-de058150b78d tempest-AttachVolumeNegativeTest-1037508314 None] attachment_update completed successfully.
Apr 02 21:10:59.783636 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-90760071-42e6-477f-b5c9-6c4b6c47a25d tempest-TaggedBootDevicesTest_v242-285856104 None] Terminate volume connection completed successfully.
Apr 02 21:10:59.808417 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-90760071-42e6-477f-b5c9-6c4b6c47a25d tempest-TaggedBootDevicesTest_v242-285856104 None] Deleting attachment 0504f853-7085-46c5-8d3d-60dff6b53f0a. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:11:00.007060 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-44cb693b-ae61-492d-9bca-19a11b9b3926 tempest-TaggedBootDevicesTest_v242-285856104 None] Terminate volume connection completed successfully.
Apr 02 21:11:00.007813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-44cb693b-ae61-492d-9bca-19a11b9b3926 tempest-TaggedBootDevicesTest_v242-285856104 None] Deleting attachment 2baff3c5-5a56-470b-a068-82531e080c59. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:11:00.219474 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-1434d4f4-f44a-454b-8517-6aa120657a10 tempest-TaggedBootDevicesTest_v242-285856104 None] Terminate volume connection completed successfully.
Apr 02 21:11:00.220387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-a2624ec1-0b67-494b-a1b5-9b3a23d75784 req-1434d4f4-f44a-454b-8517-6aa120657a10 tempest-TaggedBootDevicesTest_v242-285856104 None] Deleting attachment 9f96ade6-0f0a-4f2b-8bf0-3799b92c77e5. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:11:02.262557 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-79149c6a-d140-41fe-8f32-59239dfc23b1 req-8ffddfb3-eb5c-48ea-9cfd-164f58bbd737 tempest-AttachVolumeNegativeTest-1037508314 None] Terminate volume connection completed successfully.
Apr 02 21:11:02.265021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-79149c6a-d140-41fe-8f32-59239dfc23b1 req-8ffddfb3-eb5c-48ea-9cfd-164f58bbd737 tempest-AttachVolumeNegativeTest-1037508314 None] Deleting attachment 006348c5-adb5-4a19-8326-e778279a69d4. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:11:03.988667 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:11:04.019966 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Flow 'volume_create_manager' (ecdc85ee-458a-43a7-9053-b27f97f8f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:11:04.046036 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea400950-15ce-42e5-a82e-f0f45562aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.075883 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea400950-15ce-42e5-a82e-f0f45562aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-956505660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b42e54e9-c580-4f38-98f7-8ec72ff034bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9e9483710f0424b9c347c74a9da708a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:11:04Z,use_quota=True,user_id='d7ebf8694d674ee38bb5f58a3687a415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.086979 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba12981-4a78-4e48-9c45-409b2ae3f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.091332 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba12981-4a78-4e48-9c45-409b2ae3f76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.098119 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974020f-e2c2-498b-be79-f4a7b468fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.102671 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5974020f-e2c2-498b-be79-f4a7b468fb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'volume_name': 'volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.108134 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42767d5-8e74-41f5-91ee-2691ffcdfad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.113614 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42767d5-8e74-41f5-91ee-2691ffcdfad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.128098 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e539709-a552-4848-b526-ddee2d4148c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.129290 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume b42e54e9-c580-4f38-98f7-8ec72ff034bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'volume_size': 1}
Apr 02 21:11:04.133962 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] creating volume 'volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:11:04.134804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:04.280330 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:11:04.281116 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:11:04.285319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e539709-a552-4848-b526-ddee2d4148c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.295617 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c6d485-84fa-4aeb-8803-9739b2903328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:04.315580 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb (b42e54e9-c580-4f38-98f7-8ec72ff034bb): created successfully
Apr 02 21:11:04.322803 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c6d485-84fa-4aeb-8803-9739b2903328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:04.342871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Flow 'volume_create_manager' (ecdc85ee-458a-43a7-9053-b27f97f8f143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:11:04.364540 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d9527255-c05f-4cc0-8562-69cc2c3d6d20 tempest-ServerRescueNegativeTestJSON-1832764052 None] Created volume successfully.
Apr 02 21:11:12.380517 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:12.495735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:12.697589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:12.698269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:12.709074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] deleting rbd volume volume-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:13.254774 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Created reservations ['b64276bd-a6b5-4e0d-98d9-f23f518d94ee', '52f07a38-4c07-4a58-a754-39e42ef821ca', '5a510573-9c34-49b7-b0ee-1a71d36d7b88', '76682ed1-fd76-43d6-b220-19694701fa8f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:13.384937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:13.521920 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:13.621714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:13.628219 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Deleted volume successfully.
Apr 02 21:11:13.655900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c63cd7ca-4b70-453e-bb1f-31a1576d886e tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-6cbf0b8c-17fc-4aeb-a10c-9288e205bbb9-delete_volume'" released by "delete_volume" :: held 1.275s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:13.891732 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-696f5abc-2112-4bfb-bb0e-51027fe32d7f-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:14.031366 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:14.191891 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:14.192314 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:14.205965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] deleting rbd volume volume-696f5abc-2112-4bfb-bb0e-51027fe32d7f {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:14.344968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-fbf32828-fb67-44ff-90ac-f60db7ea410b-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:14.420971 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:14.500552 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:14.500997 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-fbf32828-fb67-44ff-90ac-f60db7ea410b is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:14.508979 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] deleting rbd volume volume-fbf32828-fb67-44ff-90ac-f60db7ea410b {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:14.673014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Created reservations ['c67b6803-22db-4b65-b425-e4cabfb83efb', '2f25998a-c625-4bdd-83dc-b42a70ff4860', '9dcafd64-730c-424b-a1e9-fbd8b92609cf', 'd7b380ea-5d46-43b8-874b-03d6eff378da'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:14.799706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:14.873571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:14.959956 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:14.979377 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Deleted volume successfully.
Apr 02 21:11:15.012351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9cb47e4a-9ab9-45c6-a027-429cc487e2bf tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-696f5abc-2112-4bfb-bb0e-51027fe32d7f-delete_volume'" released by "delete_volume" :: held 1.121s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:15.060505 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Created reservations ['b36c4222-9b2b-4900-baec-b3fa3d880c0f', '2ba2a195-6550-42df-b721-1e82c2e453d6', '7a41ff0b-a443-4ee4-93ce-5c8dafd9d596', 'b3b18088-84ba-4c22-9586-4bbccf442f1f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:15.141482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:15.242105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:15.288241 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:15.292883 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Deleted volume successfully.
Apr 02 21:11:15.311316 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-781b725e-5882-4299-b8b1-8fa1f2f74087 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-fbf32828-fb67-44ff-90ac-f60db7ea410b-delete_volume'" released by "delete_volume" :: held 0.966s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:15.534812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-53932f9c-8a1a-44d4-851d-4805a7def1fe-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:15.654295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-9dd7dd0d-7620-4ade-ae79-7c552f2cc060-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:15.658103 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:15.776573 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:15.777336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Volume volume-53932f9c-8a1a-44d4-851d-4805a7def1fe is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:15.788669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] deleting rbd volume volume-53932f9c-8a1a-44d4-851d-4805a7def1fe {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:15.889635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:16.015403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:16.015842 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Volume volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:16.035567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] deleting rbd volume volume-9dd7dd0d-7620-4ade-ae79-7c552f2cc060 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:16.397858 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Created reservations ['9281be35-eada-4ccb-84a0-83c216861880', '5ca4162a-1106-4842-a557-4118af335803', 'a3212f25-f028-4217-8103-8d796311da26', '55b5b5f0-f169-4d3f-a8ee-acafc3039427'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:16.507564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:16.633819 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:16.753138 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:16.763358 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Deleted volume successfully.
Apr 02 21:11:16.866216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0dfc9ccd-bb35-46aa-b066-e3bf84c6e150 tempest-AttachVolumeNegativeTest-1037508314 None] Lock "b'cinder-53932f9c-8a1a-44d4-851d-4805a7def1fe-delete_volume'" released by "delete_volume" :: held 1.330s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:16.921442 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Created reservations ['df4b1e0a-079a-43c7-b1c1-0ee849bb6dd0', 'd9b2fe53-86ca-4418-9f07-afd1deb61c7a', 'b94981db-4faa-48e8-9d54-3cd50e5c03d6', '74644526-2ea9-4680-9051-e38ed78a741b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:17.030364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:17.104487 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:17.178697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:17.183734 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Deleted volume successfully.
Apr 02 21:11:17.211037 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-101083f3-e291-4647-81ba-54c2c4f405ca tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-9dd7dd0d-7620-4ade-ae79-7c552f2cc060-delete_volume'" released by "delete_volume" :: held 1.557s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:17.983550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-2391b2a9-e519-4491-b2dd-b9c8719a7a94-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:18.064522 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:18.237157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:18.258022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] deleting rbd volume volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:18.855043 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:11:18.901880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] deleting parent snapshot volume-2391b2a9-e519-4491-b2dd-b9c8719a7a94.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:11:19.641653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] Created reservations ['18d9a563-742a-4690-8ba2-d8b358b49710', 'cc314d32-e66e-4148-acfa-2d8f123c2a37', '0c0f52c3-01de-4685-83aa-c152e1d8d79f', 'ab2ed876-7d23-43cb-9dbd-c95b85db9afc'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:19.845421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:19.962141 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:20.095063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:20.109177 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] Deleted volume successfully.
Apr 02 21:11:20.132725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-aa5c972e-6845-4d1d-b3bf-7dce22cecdc9 tempest-TaggedBootDevicesTest_v242-285856104 None] Lock "b'cinder-2391b2a9-e519-4491-b2dd-b9c8719a7a94-delete_volume'" released by "delete_volume" :: held 2.149s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:28.811524 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:11:28.812562 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:28.911194 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:28.968728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:32.169342 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:11:32.214480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Flow 'volume_create_manager' (01c25401-5e1f-48a1-ad3c-87089b443b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:11:32.222583 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71bfef-c745-468d-a874-f5eae40007a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.268834 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71bfef-c745-468d-a874-f5eae40007a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1264017565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be5d68a8-39e5-42c9-a3b7-74e6ec72b117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b35f02593444d7bbdccd00bacc80d91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:11:32Z,use_quota=True,user_id='7a73a60251ba40e289786434dd83c382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.281961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e155bab-93e2-47d5-80ba-1b56a911e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.293829 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e155bab-93e2-47d5-80ba-1b56a911e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.305526 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d73349e-5b9c-4d24-9a6e-65aa05e139e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.316289 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d73349e-5b9c-4d24-9a6e-65aa05e139e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5d68a8-39e5-42c9-a3b7-74e6ec72b117', 'volume_name': 'volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.330409 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba2459c-d591-488c-83db-2c6aa95047ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.338822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba2459c-d591-488c-83db-2c6aa95047ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.353005 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85f715a-b1c2-48e8-85ba-4387963ad9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.361024 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Volume be5d68a8-39e5-42c9-a3b7-74e6ec72b117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117', 'volume_size': 1}
Apr 02 21:11:32.361513 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] creating volume 'volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:11:32.362393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:32.534952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:11:32.534952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:11:32.534952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85f715a-b1c2-48e8-85ba-4387963ad9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.548160 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849d5388-2b63-4f3f-9c50-095a91384cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:11:32.602879 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Volume volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117 (be5d68a8-39e5-42c9-a3b7-74e6ec72b117): created successfully
Apr 02 21:11:32.606962 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849d5388-2b63-4f3f-9c50-095a91384cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:11:32.618027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Flow 'volume_create_manager' (01c25401-5e1f-48a1-ad3c-87089b443b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:11:32.647304 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-732b2eb8-1f59-45b8-bd31-cafe56250649 req-eb180050-370e-434d-86b6-0bcd0bd344fc tempest-VolumesSnapshotsTestJSON-1887529960 None] Created volume successfully.
Apr 02 21:11:33.701593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-46bab292-00f0-4da1-bf56-5a2296f3f2ed req-08b5dc90-9739-4bdd-b965-90b10680e735 tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:34.712279 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-46bab292-00f0-4da1-bf56-5a2296f3f2ed req-08b5dc90-9739-4bdd-b965-90b10680e735 tempest-VolumesSnapshotsTestJSON-1887529960 None] Create snapshot completed successfully
Apr 02 21:11:35.098379 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] Lock "b'cinder-59015f0a-1a7f-4d2a-8217-58557722fd2b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:35.111944 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:35.690577 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:11:35.742633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] Created reservations ['55e102ab-eb4f-47fd-810f-a149911f2d3a', '2c102acb-fb13-4d8d-b07b-bab0d14a580c', '1e5433b4-cc64-406d-bc60-0a84537cf6bb', '30388143-c717-458f-874a-fcaa6408574e'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:35.871729 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] Delete snapshot completed successfully.
Apr 02 21:11:35.885117 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-c8b20ac0-b132-4f62-93aa-2055d93b98e3 req-1660febc-1120-4701-8ec7-625d462ee998 tempest-VolumesSnapshotsTestJSON-1887529960 None] Lock "b'cinder-59015f0a-1a7f-4d2a-8217-58557722fd2b-delete_snapshot'" released by "delete_snapshot" :: held 0.786s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:11:36.614362 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Lock "b'cinder-be5d68a8-39e5-42c9-a3b7-74e6ec72b117-delete_volume'" acquired by "delete_volume" :: waited 0.030s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:11:36.778417 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:36.913567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:11:36.914307 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Volume volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:11:36.930457 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] deleting rbd volume volume-be5d68a8-39e5-42c9-a3b7-74e6ec72b117 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:11:37.495821 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Created reservations ['ce2bfb6c-7296-43a4-9e4f-061f4eeaa801', '5d3f6f53-c7dc-463b-8f67-a78fe5f55f36', '703c00c1-eb71-4d5e-9243-ebf726e66f2d', 'b7e3c9f3-1195-4eff-977a-c1cdf37e7f03'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:11:37.624669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:37.739446 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:11:37.809931 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:11:37.814658 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Deleted volume successfully.
Apr 02 21:11:37.848648 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-d2197fa5-400f-4346-9fc3-a1dc88642054 req-07d1ae9d-ffc9-42eb-a8cf-0f8f16ec683a tempest-VolumesSnapshotsTestJSON-1887529960 None] Lock "b'cinder-be5d68a8-39e5-42c9-a3b7-74e6ec72b117-delete_volume'" released by "delete_volume" :: held 1.234s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:12:28.820734 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:12:28.821416 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:28.881635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:28.936593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:12:35.434719 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:12:35.455394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (7a38f273-e3a2-4c41-b352-4a54eaac2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:12:35.464487 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1ea781-9f18-47c2-b4c9-89a01d5b6d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.481254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1ea781-9f18-47c2-b4c9-89a01d5b6d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-476326504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=598ae540-738c-4ad1-aa4f-c1e5f13e1481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733befed769a4ec29b3f10b0efd4504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:12:35Z,use_quota=True,user_id='9c65eea593394a6483c4b998a2ef1340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.487184 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c76ee-be16-4155-94b7-aa112e2d2153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.492022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c76ee-be16-4155-94b7-aa112e2d2153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.499241 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abfa5ad-da38-4806-b4a3-f94cf2cc77a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.503593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abfa5ad-da38-4806-b4a3-f94cf2cc77a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'volume_name': 'volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.508666 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ccaf5b-be5e-4935-b52a-636d58106e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.513713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ccaf5b-be5e-4935-b52a-636d58106e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.518548 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c7ce25-3783-4602-8de1-885f3c72f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.519627 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Volume 598ae540-738c-4ad1-aa4f-c1e5f13e1481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'volume_size': 1}
Apr 02 21:12:35.520027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] creating volume 'volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:12:35.520836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:35.598233 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:12:35.599102 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:12:35.607542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c7ce25-3783-4602-8de1-885f3c72f82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.614230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34b446f-f2b4-43a3-af1e-dd71ad95270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:35.625022 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481 (598ae540-738c-4ad1-aa4f-c1e5f13e1481): created successfully
Apr 02 21:12:35.629419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34b446f-f2b4-43a3-af1e-dd71ad95270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:35.635411 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (7a38f273-e3a2-4c41-b352-4a54eaac2b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:12:35.646351 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c1ec4fff-6740-4227-9048-a2ad64fd8eb8 tempest-VolumesBackupsAdminTest-119965354 None] Created volume successfully.
Apr 02 21:12:36.915662 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:12:36Z,data_timestamp=2022-04-02T21:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-713776170',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=eebc0cd6-3a4c-4d2b-881f-2a7fc5841351,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='733befed769a4ec29b3f10b0efd4504f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='9c65eea593394a6483c4b998a2ef1340',volume_id=598ae540-738c-4ad1-aa4f-c1e5f13e1481)
Apr 02 21:12:36.923246 ncdv-master-1 cinder-volume[129783]: INFO cinder.rpc [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Apr 02 21:12:36.940363 ncdv-master-1 cinder-volume[129783]: INFO cinder.rpc [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Apr 02 21:12:36.941511 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] continue_backup in rpcapi backup_id eebc0cd6-3a4c-4d2b-881f-2a7fc5841351 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:12:43.812079 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:12:44.567336 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.755s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:12:44.568519 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '598ae540-738c-4ad1-aa4f-c1e5f13e1481', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:12:44.598297 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Initialize volume connection completed successfully.
Apr 02 21:12:48.800830 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Terminate volume connection completed successfully.
Apr 02 21:12:48.819457 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fcda4aee-adb9-4f6b-9ef2-92231ffbbaa3 tempest-VolumesBackupsAdminTest-119965354 None] Remove volume export completed successfully.
Apr 02 21:12:51.542178 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:12:51.594826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (53851296-ec97-45fe-956a-7dcddb7888e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:12:51.607167 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1559ed65-6ecf-4881-a1f2-8bdd5175316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.631760 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1559ed65-6ecf-4881-a1f2-8bdd5175316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:12:51Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_eebc0cd6-3a4c-4d2b-881f-2a7fc5841351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=71da2da2-6544-44ed-b674-74a5996b026c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733befed769a4ec29b3f10b0efd4504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:12:51Z,use_quota=True,user_id='9c65eea593394a6483c4b998a2ef1340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.640242 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346da6a6-f9d3-45b8-a512-c6760383e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.647020 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346da6a6-f9d3-45b8-a512-c6760383e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.655852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901760b-b6d1-421f-afa8-23767bc12a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.664832 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0901760b-b6d1-421f-afa8-23767bc12a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71da2da2-6544-44ed-b674-74a5996b026c', 'volume_name': 'volume-71da2da2-6544-44ed-b674-74a5996b026c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.670878 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9070a0-1097-495a-bab3-092b8dcdb76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.675580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9070a0-1097-495a-bab3-092b8dcdb76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.681848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5580914f-8483-4e0b-94d5-3e0aefe4287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.683459 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Volume 71da2da2-6544-44ed-b674-74a5996b026c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71da2da2-6544-44ed-b674-74a5996b026c', 'volume_size': 1}
Apr 02 21:12:51.684670 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] creating volume 'volume-71da2da2-6544-44ed-b674-74a5996b026c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:12:51.686176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:51.778749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:12:51.779480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:12:51.783604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5580914f-8483-4e0b-94d5-3e0aefe4287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71da2da2-6544-44ed-b674-74a5996b026c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.788959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0e76c7-9aba-471d-bccc-49deb8a7288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:51.797838 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-71da2da2-6544-44ed-b674-74a5996b026c (71da2da2-6544-44ed-b674-74a5996b026c): created successfully
Apr 02 21:12:51.801563 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0e76c7-9aba-471d-bccc-49deb8a7288d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:51.808315 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (53851296-ec97-45fe-956a-7dcddb7888e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:12:51.817683 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Created volume successfully.
Apr 02 21:12:52.812544 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:12:53.918032 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.105s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:12:53.919044 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-71da2da2-6544-44ed-b674-74a5996b026c', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '71da2da2-6544-44ed-b674-74a5996b026c', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:12:53.951224 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Initialize volume connection completed successfully.
Apr 02 21:12:55.865179 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-61316f85-aefd-44b5-94c0-c38be6476501 req-a659481b-b2c6-4a95-8ca9-91671f36be38 tempest-ServerRescueNegativeTestJSON-1832764052 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:12:55.931251 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Terminate volume connection completed successfully.
Apr 02 21:12:55.952678 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ac4c3124-1fbb-4f41-9938-8e0ebcc65132 tempest-VolumesBackupsAdminTest-119965354 None] Remove volume export completed successfully.
Apr 02 21:12:56.683698 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-61316f85-aefd-44b5-94c0-c38be6476501 req-a659481b-b2c6-4a95-8ca9-91671f36be38 tempest-ServerRescueNegativeTestJSON-1832764052 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.819s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:12:56.684435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-61316f85-aefd-44b5-94c0-c38be6476501 req-a659481b-b2c6-4a95-8ca9-91671f36be38 tempest-ServerRescueNegativeTestJSON-1832764052 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:12:56.722366 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-61316f85-aefd-44b5-94c0-c38be6476501 req-a659481b-b2c6-4a95-8ca9-91671f36be38 tempest-ServerRescueNegativeTestJSON-1832764052 None] Connection info returned from driver {'name': 'volumes/volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b42e54e9-c580-4f38-98f7-8ec72ff034bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f61542f6-719b-482c-9cd7-ddd8709bb570'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:12:56.787125 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-61316f85-aefd-44b5-94c0-c38be6476501 req-a659481b-b2c6-4a95-8ca9-91671f36be38 tempest-ServerRescueNegativeTestJSON-1832764052 None] attachment_update completed successfully.
Apr 02 21:12:56.966898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-71da2da2-6544-44ed-b674-74a5996b026c-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:12:57.061792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:57.643342 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-71da2da2-6544-44ed-b674-74a5996b026c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:12:57.671009 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] deleting rbd volume volume-71da2da2-6544-44ed-b674-74a5996b026c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:12:57.949604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Created reservations ['c2d880bf-87c3-4c9b-a30b-95ba826d0424', 'e1f59dca-5316-4262-a2c1-1a90de4b60e0', '23b19b7f-b3c0-4f77-8fc9-221a033c8f2a', 'dd80a0b6-796e-4fa1-a0ab-d9d288317f23'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:12:58.000205 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:58.044439 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:58.091976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:12:58.097005 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Deleted volume successfully.
Apr 02 21:12:58.112804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1c4acf92-45d7-4af4-ae22-00921b1210fc tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-71da2da2-6544-44ed-b674-74a5996b026c-delete_volume'" released by "delete_volume" :: held 1.146s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:12:59.764717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:12:59.788505 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (ecdc1f22-c823-4035-9867-c3b196567dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:12:59.795714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7003a44-5982-4fa9-ab68-661ad38d87e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:59.813727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7003a44-5982-4fa9-ab68-661ad38d87e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1660316579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4be85628-1d3b-468d-96cb-ed8984971395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='733befed769a4ec29b3f10b0efd4504f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:00Z,use_quota=True,user_id='9c65eea593394a6483c4b998a2ef1340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:59.820407 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ca85f9-40ed-45fb-87d0-272545e64e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:59.825978 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ca85f9-40ed-45fb-87d0-272545e64e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:59.831910 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcae6ec-1f4d-40da-8318-b1ba414aae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:59.841143 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcae6ec-1f4d-40da-8318-b1ba414aae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be85628-1d3b-468d-96cb-ed8984971395', 'volume_name': 'volume-4be85628-1d3b-468d-96cb-ed8984971395', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:59.846934 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e7b49b-fa5d-465d-99c7-360c57233804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:59.851200 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e7b49b-fa5d-465d-99c7-360c57233804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:59.857896 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913eb555-918d-463a-a312-876d6250e6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:12:59.859468 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Volume 4be85628-1d3b-468d-96cb-ed8984971395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be85628-1d3b-468d-96cb-ed8984971395', 'volume_size': 1}
Apr 02 21:12:59.859869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] creating volume 'volume-4be85628-1d3b-468d-96cb-ed8984971395' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:12:59.860788 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:12:59.983533 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:12:59.983895 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:12:59.991904 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913eb555-918d-463a-a312-876d6250e6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be85628-1d3b-468d-96cb-ed8984971395', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:12:59.999985 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9279501c-4244-4891-b30c-89b5c3b557ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:00.014571 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-4be85628-1d3b-468d-96cb-ed8984971395 (4be85628-1d3b-468d-96cb-ed8984971395): created successfully
Apr 02 21:13:00.019497 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9279501c-4244-4891-b30c-89b5c3b557ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:00.026618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Flow 'volume_create_manager' (ecdc1f22-c823-4035-9867-c3b196567dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:00.038707 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-23e02bbf-7166-467e-9940-869bc897aa6d tempest-VolumesBackupsAdminTest-119965354 None] Created volume successfully.
Apr 02 21:13:01.067071 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:13:00Z,data_timestamp=2022-04-02T21:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1178197629',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=b95dff28-554e-45c2-a740-5f66c9c2f3d4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='733befed769a4ec29b3f10b0efd4504f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='9c65eea593394a6483c4b998a2ef1340',volume_id=4be85628-1d3b-468d-96cb-ed8984971395)
Apr 02 21:13:01.067958 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] continue_backup in rpcapi backup_id b95dff28-554e-45c2-a740-5f66c9c2f3d4 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:13:01.216435 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:13:02.019175 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.802s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:13:02.023860 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4be85628-1d3b-468d-96cb-ed8984971395', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '4be85628-1d3b-468d-96cb-ed8984971395', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:13:02.075973 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] Initialize volume connection completed successfully.
Apr 02 21:13:03.666058 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] Terminate volume connection completed successfully.
Apr 02 21:13:03.692788 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cf8fc03e-7dd9-4280-bf27-68a8b2934a83 tempest-VolumesBackupsAdminTest-119965354 None] Remove volume export completed successfully.
Apr 02 21:13:06.551047 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-4be85628-1d3b-468d-96cb-ed8984971395-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:06.650689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:07.498575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-4be85628-1d3b-468d-96cb-ed8984971395 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:07.535697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] deleting rbd volume volume-4be85628-1d3b-468d-96cb-ed8984971395 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:07.957421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Created reservations ['678fb1c6-800e-4c6c-a946-93998993d421', '628f3f2f-9c28-4361-b425-cf8c3f045484', '62eb8aa7-96c4-420f-a88a-0beadf7a32ff', '28b49ac9-eaf4-49e6-857d-a10b2299105e'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:08.014496 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:08.083116 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:08.159795 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:08.165163 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Deleted volume successfully.
Apr 02 21:13:08.187001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-33b4082f-c2ae-492e-8a61-7dd743172693 tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-4be85628-1d3b-468d-96cb-ed8984971395-delete_volume'" released by "delete_volume" :: held 1.639s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:08.894398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-598ae540-738c-4ad1-aa4f-c1e5f13e1481-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:08.959472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:09.641704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Volume volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:09.667271 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] deleting rbd volume volume-598ae540-738c-4ad1-aa4f-c1e5f13e1481 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:10.068243 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Created reservations ['1d4ca695-786a-49d3-8900-7ec637c93a18', 'ea60c29c-3c27-4233-9c82-cb182b150f1c', '5513c3b6-bdb1-4750-a40d-107e8dbf8311', 'c71dea61-4f88-43bc-90b1-db8d3e83697b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:10.129959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:10.172649 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:10.208310 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:10.219209 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Deleted volume successfully.
Apr 02 21:13:10.245832 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-50376ba8-51a0-4129-a18e-32311aed59b6 tempest-VolumesBackupsAdminTest-119965354 None] Lock "b'cinder-598ae540-738c-4ad1-aa4f-c1e5f13e1481-delete_volume'" released by "delete_volume" :: held 1.351s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:15.812546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:15.866467 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Flow 'volume_create_manager' (a8c60aa1-8d95-4d1b-97d9-09fa6dfbc89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:15.892228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e24fc39-e82c-4078-aa39-e5f9b3c09a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:15.914168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e24fc39-e82c-4078-aa39-e5f9b3c09a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-339120544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=15f5e54d-abb0-43aa-a0c2-4fa5051e76bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f59aaf22978e4c75a101f51d2081db70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:16Z,use_quota=True,user_id='77639746ed634064b00001f0a78bdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:15.925841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1945660-2af7-4f6d-a1ec-fd596238d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:15.930577 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1945660-2af7-4f6d-a1ec-fd596238d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:15.937084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e04b43d-d62c-44bd-b8e6-0cbd98df1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:16.057591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e04b43d-d62c-44bd-b8e6-0cbd98df1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15f5e54d-abb0-43aa-a0c2-4fa5051e76bf', 'volume_name': 'volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dc640>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:16.063599 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f79e84f-ea5c-4ed1-be6f-2d6544efe521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:16.067886 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f79e84f-ea5c-4ed1-be6f-2d6544efe521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:16.073206 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf9986-232d-4516-8037-efa5e96a93d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:16.074675 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Volume 15f5e54d-abb0-43aa-a0c2-4fa5051e76bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dc640>}
Apr 02 21:13:16.075263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Cloning 15f5e54d-abb0-43aa-a0c2-4fa5051e76bf from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:13:16.084184 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:16.098542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 13, 16, 88626)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:13:16.099053 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:13:16.099554 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:13:16.107290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:16.108824 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:13:16.118312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 13, 16, 114173)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:13:16.119040 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:13:16.119664 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:13:16.133152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:16.224296 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] creating snapshot='volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:13:16.733721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf.clone_snap' to 'volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:13:16.756480 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-63fa9c27-830e-42bd-b780-40f2c7f2ec31 tempest-GroupsTest-177939402 None] Group tempest-Group1-1494508998: creating
Apr 02 21:13:16.797817 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-63fa9c27-830e-42bd-b780-40f2c7f2ec31 tempest-GroupsTest-177939402 None] Group tempest-Group1-1494508998: created successfully
Apr 02 21:13:16.809346 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-63fa9c27-830e-42bd-b780-40f2c7f2ec31 tempest-GroupsTest-177939402 None] Create group completed successfully.
Apr 02 21:13:16.956104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:16.958135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:16.959524 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:16.996610 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:13:16.997580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Marking volume 15f5e54d-abb0-43aa-a0c2-4fa5051e76bf as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:13:17.011600 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 15f5e54d-abb0-43aa-a0c2-4fa5051e76bf. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:13:17.017741 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Creating volume glance metadata for volume 15f5e54d-abb0-43aa-a0c2-4fa5051e76bf backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:13:17.119343 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf9986-232d-4516-8037-efa5e96a93d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953dc640>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:17.124083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ebd73f-32fc-44df-8ac6-9be8e3c95d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:17.135976 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Volume volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf (15f5e54d-abb0-43aa-a0c2-4fa5051e76bf): created successfully
Apr 02 21:13:17.141828 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ebd73f-32fc-44df-8ac6-9be8e3c95d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:17.147412 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Flow 'volume_create_manager' (a8c60aa1-8d95-4d1b-97d9-09fa6dfbc89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:17.158310 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0b3e4ade-8fb5-49a8-8a05-f65b2c69a04d tempest-VolumesImageMetadata-1840312369 None] Created volume successfully.
Apr 02 21:13:17.732514 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-68955c73-17e3-44b2-a27b-99257e8196b4 tempest-GroupsTest-177939402 None] Group tempest-Group2-1426732724: creating
Apr 02 21:13:17.752596 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-68955c73-17e3-44b2-a27b-99257e8196b4 tempest-GroupsTest-177939402 None] Group tempest-Group2-1426732724: created successfully
Apr 02 21:13:17.762644 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-68955c73-17e3-44b2-a27b-99257e8196b4 tempest-GroupsTest-177939402 None] Create group completed successfully.
Apr 02 21:13:18.198921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] Lock "b'cinder-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:18.242010 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:18.336059 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:18.349189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] deleting rbd volume volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:18.543681 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:13:18.576323 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] deleting parent snapshot volume-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:13:19.697521 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:19.717749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (6373a19c-f110-4097-a3fc-c8bc85cf8fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:19.725460 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c5153-a735-409e-910b-7eb5a2589733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.746180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c5153-a735-409e-910b-7eb5a2589733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774322449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=de18b799-0858-4360-a8ad-e5ec97171d63,host='ncdv-master-1@ceph#ceph',id=377654ee-4415-46ea-903a-038e5367b1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017cba720ab34ba1b9e02ba206ae26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:19Z,use_quota=True,user_id='6ea7ea61f3144dd08f1c73fdae9064b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cff4332b-d8c2-4eac-bd2f-f7da38ae2fc6),volume_type_id=cff4332b-d8c2-4eac-bd2f-f7da38ae2fc6)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.751721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132ad45e-20ec-45c9-bc6a-d7300f8da735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.756492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (132ad45e-20ec-45c9-bc6a-d7300f8da735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.763374 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013ba04a-ba08-4e31-8a14-3e5ee5e22394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.767977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013ba04a-ba08-4e31-8a14-3e5ee5e22394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '377654ee-4415-46ea-903a-038e5367b1a6', 'volume_name': 'volume-377654ee-4415-46ea-903a-038e5367b1a6', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.776853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c310fd-1852-462b-8b0e-2837c0bee3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.781541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c310fd-1852-462b-8b0e-2837c0bee3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.787396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5131c-10be-4196-b285-e1fe8652de27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.788922 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Volume 377654ee-4415-46ea-903a-038e5367b1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-377654ee-4415-46ea-903a-038e5367b1a6', 'volume_size': 1}
Apr 02 21:13:19.789501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] creating volume 'volume-377654ee-4415-46ea-903a-038e5367b1a6' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:19.791462 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:19.860813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] Created reservations ['8a1991fc-bb50-459c-881a-d9596546d902', '218318f7-d549-45c7-9bf6-015f6ccbba7a', 'dda8b886-827f-46ac-99ed-01e7884a2a69', 'b161287f-f8fa-4bd6-a403-0ed58db2cdcf'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:19.903254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:19.903732 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:19.908865 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b5131c-10be-4196-b285-e1fe8652de27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-377654ee-4415-46ea-903a-038e5367b1a6', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.915290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f035c1a9-102e-4810-906f-1b2aa5a5924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:19.933068 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Volume volume-377654ee-4415-46ea-903a-038e5367b1a6 (377654ee-4415-46ea-903a-038e5367b1a6): created successfully
Apr 02 21:13:19.937215 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f035c1a9-102e-4810-906f-1b2aa5a5924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:19.944643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (6373a19c-f110-4097-a3fc-c8bc85cf8fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:19.958222 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-86a8e7e9-ef42-4a6a-b8d2-cbe3a850be01 tempest-GroupsTest-177939402 None] Created volume successfully.
Apr 02 21:13:19.977052 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:20.017100 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:20.043332 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:20.055392 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] Deleted volume successfully.
Apr 02 21:13:20.070064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4aaaa136-550a-4f33-a58a-e44841731826 tempest-VolumesImageMetadata-1840312369 None] Lock "b'cinder-15f5e54d-abb0-43aa-a0c2-4fa5051e76bf-delete_volume'" released by "delete_volume" :: held 1.871s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:21.012376 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:21.129344 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:21.130061 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Volume volume-377654ee-4415-46ea-903a-038e5367b1a6 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:21.140549 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] deleting rbd volume volume-377654ee-4415-46ea-903a-038e5367b1a6 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:21.583459 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Created reservations ['1e6590ef-74f7-4aa8-afd6-f8b6776cc039'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:21.603654 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1797212032 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1797212032, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:21.604486 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1797212032 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1797212032, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:21.622447 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Created reservations ['84e6d734-590c-4cfe-8bb3-b7cbd8cb49fa', 'd536a6c0-28d2-4176-a36b-01ff97b68d74', '1e580f73-8ef6-46c9-9d35-b715cffbfb6d', '1f7ae4c1-a7e1-4dde-8334-62509a597af7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:21.746057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:21.804652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:21.849069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:21.854450 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bb3ee3b6-aa48-4e9b-aeb4-c836e7059df0 tempest-GroupsTest-177939402 None] Delete group completed successfully.
Apr 02 21:13:22.266210 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-679337ef-1a09-4571-9afa-2b05188aa169 tempest-GroupsTest-177939402 None] Created reservations ['a3ddf2e6-5957-465f-b357-76226dd598e4'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:22.335255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-679337ef-1a09-4571-9afa-2b05188aa169 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:22.395213 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-679337ef-1a09-4571-9afa-2b05188aa169 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:22.506363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-679337ef-1a09-4571-9afa-2b05188aa169 tempest-GroupsTest-177939402 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:22.515802 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-679337ef-1a09-4571-9afa-2b05188aa169 tempest-GroupsTest-177939402 None] Delete group completed successfully.
Apr 02 21:13:23.908951 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-aa4e4f33-df67-4fd2-845e-0ad71c73d0c2 tempest-GroupsTest-177939402 None] Group tempest-GroupsTest-Group-670145292: creating
Apr 02 21:13:23.929683 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-aa4e4f33-df67-4fd2-845e-0ad71c73d0c2 tempest-GroupsTest-177939402 None] Group tempest-GroupsTest-Group-670145292: created successfully
Apr 02 21:13:23.940230 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-aa4e4f33-df67-4fd2-845e-0ad71c73d0c2 tempest-GroupsTest-177939402 None] Create group completed successfully.
Apr 02 21:13:24.750597 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:24.772593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Flow 'volume_create_manager' (d322efab-6e0b-4304-9f07-0844d412491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:24.785594 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e70d4e-5f2d-4618-920f-30ceecf77718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.804168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e70d4e-5f2d-4618-920f-30ceecf77718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1127071093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9da1ed4f-dc15-4c92-ab85-c8a8afc14688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9106d7517e6a43d9bf672506311f07a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:25Z,use_quota=True,user_id='8463bc2767c84376bbd3c881573afba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.810303 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5cf76b-10d4-4806-8bc4-16724bad6001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.814848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5cf76b-10d4-4806-8bc4-16724bad6001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.821687 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df2bef-b0cb-4c73-bc5c-77ef14786228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.826319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48df2bef-b0cb-4c73-bc5c-77ef14786228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da1ed4f-dc15-4c92-ab85-c8a8afc14688', 'volume_name': 'volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.831386 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35080af-6932-4a4f-abc9-b4354616380a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.837289 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35080af-6932-4a4f-abc9-b4354616380a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.842573 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1393633d-b6b8-4722-b929-671999874f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.843692 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Volume 9da1ed4f-dc15-4c92-ab85-c8a8afc14688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688', 'volume_size': 1}
Apr 02 21:13:24.844093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] creating volume 'volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:24.844913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:24.935478 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:24.936599 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:24.941103 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1393633d-b6b8-4722-b929-671999874f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.946546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b60745-c7bb-4bd8-9fcd-83af8dcb3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:24.956156 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Volume volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688 (9da1ed4f-dc15-4c92-ab85-c8a8afc14688): created successfully
Apr 02 21:13:24.960443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b60745-c7bb-4bd8-9fcd-83af8dcb3831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:24.967746 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Flow 'volume_create_manager' (d322efab-6e0b-4304-9f07-0844d412491f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:24.978697 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1c4aaa32-6f40-4d73-98b0-40321a7e72ad tempest-VolumesTransfersV355Test-1342769664 None] Created volume successfully.
Apr 02 21:13:25.538541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:25.562026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (01c3f348-3929-4d75-9824-70d803dde092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:25.571514 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b37e3d-01d7-40d8-8d30-6f48d64a5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.596769 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b37e3d-01d7-40d8-8d30-6f48d64a5202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-234270291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93491c06-a64c-438d-a292-168a195522fb,host='ncdv-master-1@ceph#ceph',id=a09e1e48-225b-42f7-900d-8663dfaa46ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017cba720ab34ba1b9e02ba206ae26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:25Z,use_quota=True,user_id='6ea7ea61f3144dd08f1c73fdae9064b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b8f58a9-ca60-46e4-8007-e92517549e11),volume_type_id=0b8f58a9-ca60-46e4-8007-e92517549e11)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.609567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a293099-8597-48b1-97c9-b9da8ea4b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.616413 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a293099-8597-48b1-97c9-b9da8ea4b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.626590 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b93f66-531c-4bfd-b215-660186de0fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.634612 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b93f66-531c-4bfd-b215-660186de0fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09e1e48-225b-42f7-900d-8663dfaa46ae', 'volume_name': 'volume-a09e1e48-225b-42f7-900d-8663dfaa46ae', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.648162 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c009a1-274b-464c-bdb3-630700777125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.656605 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c009a1-274b-464c-bdb3-630700777125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.665428 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0801c7e7-bb36-4e46-862f-ba654bbaa2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.666875 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Volume a09e1e48-225b-42f7-900d-8663dfaa46ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09e1e48-225b-42f7-900d-8663dfaa46ae', 'volume_size': 1}
Apr 02 21:13:25.668285 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] creating volume 'volume-a09e1e48-225b-42f7-900d-8663dfaa46ae' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:25.669190 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:25.812149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:25.812688 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:25.816971 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0801c7e7-bb36-4e46-862f-ba654bbaa2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09e1e48-225b-42f7-900d-8663dfaa46ae', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.823185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70cb12d-b12b-464e-9457-14263eaaf1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:25.836771 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Volume volume-a09e1e48-225b-42f7-900d-8663dfaa46ae (a09e1e48-225b-42f7-900d-8663dfaa46ae): created successfully
Apr 02 21:13:25.841671 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70cb12d-b12b-464e-9457-14263eaaf1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:25.854229 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (01c3f348-3929-4d75-9824-70d803dde092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:25.873716 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7f2974e5-8877-4fbc-85a8-64533f38999c tempest-GroupsTest-177939402 None] Created volume successfully.
Apr 02 21:13:26.592166 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2dfde206-12c7-4af8-a142-c90ab282bb7e tempest-VolumesTransfersV355Test-681948551 None] Transfer volume completed successfully.
Apr 02 21:13:27.043889 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:27.080508 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (27bd8d0f-95a6-4dc8-a4bd-b5225a5fbfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:27.088318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369bac72-9a6d-48ca-818c-a670f87477ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.105340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369bac72-9a6d-48ca-818c-a670f87477ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-149472767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=93491c06-a64c-438d-a292-168a195522fb,host='ncdv-master-1@ceph#ceph',id=0174e9ea-04d3-4e3a-b393-621a11d10102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017cba720ab34ba1b9e02ba206ae26aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:27Z,use_quota=True,user_id='6ea7ea61f3144dd08f1c73fdae9064b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b8f58a9-ca60-46e4-8007-e92517549e11),volume_type_id=0b8f58a9-ca60-46e4-8007-e92517549e11)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.111364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9a351b-1db6-49cb-bad0-dfd07b8c4b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.115739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9a351b-1db6-49cb-bad0-dfd07b8c4b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.121577 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1189684-a4f1-4293-92cc-4dd822a2c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.125907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1189684-a4f1-4293-92cc-4dd822a2c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0174e9ea-04d3-4e3a-b393-621a11d10102', 'volume_name': 'volume-0174e9ea-04d3-4e3a-b393-621a11d10102', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.131426 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec522b72-f11d-4276-b138-039184ac5f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.136509 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec522b72-f11d-4276-b138-039184ac5f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.142713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844911ba-6ea7-417c-b10e-a0aa6dbb6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.144621 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Volume 0174e9ea-04d3-4e3a-b393-621a11d10102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0174e9ea-04d3-4e3a-b393-621a11d10102', 'volume_size': 1}
Apr 02 21:13:27.145173 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] creating volume 'volume-0174e9ea-04d3-4e3a-b393-621a11d10102' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:27.146004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:27.201552 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Lock "b'cinder-9da1ed4f-dc15-4c92-ab85-c8a8afc14688-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:27.230804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:27.284352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:27.285099 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Volume volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:27.291917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] deleting rbd volume volume-9da1ed4f-dc15-4c92-ab85-c8a8afc14688 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:27.299417 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:27.300172 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:27.303988 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844911ba-6ea7-417c-b10e-a0aa6dbb6df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0174e9ea-04d3-4e3a-b393-621a11d10102', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.310389 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a4a245-bbd2-482c-84bc-4367814502cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:27.322614 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Volume volume-0174e9ea-04d3-4e3a-b393-621a11d10102 (0174e9ea-04d3-4e3a-b393-621a11d10102): created successfully
Apr 02 21:13:27.330536 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a4a245-bbd2-482c-84bc-4367814502cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:27.337636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Flow 'volume_create_manager' (27bd8d0f-95a6-4dc8-a4bd-b5225a5fbfa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:27.347315 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d9831ae2-bce0-4088-a913-2d98211a2794 tempest-GroupsTest-177939402 None] Created volume successfully.
Apr 02 21:13:27.562879 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Created reservations ['73346eb6-0911-47a1-882f-9fe2ed09993e', 'b555111c-a4bd-4b31-8bf0-bc7d98967a52', 'd266577b-0054-4632-a275-c33e36c36bab', 'f2620ba9-4306-4106-be04-ec2aed48e0ac'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:27.620152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:27.663456 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:27.706685 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:27.711933 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Deleted volume successfully.
Apr 02 21:13:27.729626 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-36765098-78f0-495e-8def-41877dded63d tempest-VolumesTransfersV355Test-122621544 None] Lock "b'cinder-9da1ed4f-dc15-4c92-ab85-c8a8afc14688-delete_volume'" released by "delete_volume" :: held 0.528s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:28.231098 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-34f932b8-9873-405e-9cb6-2fadab6c74a1 tempest-GroupsTest-177939402 None] Update group completed successfully.
Apr 02 21:13:28.566547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:28.585537 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Flow 'volume_create_manager' (205e254e-1942-4f54-9281-6142fd45e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:28.592662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec3f911-3889-4e8e-b085-b9ba628f008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.609827 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec3f911-3889-4e8e-b085-b9ba628f008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-523097536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec01d1ea-5441-4bd9-9e65-8c2a563cdb87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9106d7517e6a43d9bf672506311f07a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:29Z,use_quota=True,user_id='8463bc2767c84376bbd3c881573afba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.616703 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2916a956-95ce-4a01-9acd-921e1ebb5e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.621703 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2916a956-95ce-4a01-9acd-921e1ebb5e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.628630 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f378fca-e12e-4617-af5b-7b996f9126f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.633111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f378fca-e12e-4617-af5b-7b996f9126f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec01d1ea-5441-4bd9-9e65-8c2a563cdb87', 'volume_name': 'volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.638836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fce35e4-8967-4e93-8c9c-efc7fb0e49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.642727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fce35e4-8967-4e93-8c9c-efc7fb0e49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.647407 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c748b9f-426c-4cf6-9a42-abbebcab922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.648486 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Volume ec01d1ea-5441-4bd9-9e65-8c2a563cdb87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87', 'volume_size': 1}
Apr 02 21:13:28.648880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] creating volume 'volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:28.649656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:28.728542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:28.729080 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:28.733068 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c748b9f-426c-4cf6-9a42-abbebcab922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.737667 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3466f43-a974-492f-a762-3627a54aa188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:28.747419 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Volume volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87 (ec01d1ea-5441-4bd9-9e65-8c2a563cdb87): created successfully
Apr 02 21:13:28.751251 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3466f43-a974-492f-a762-3627a54aa188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:28.756714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Flow 'volume_create_manager' (205e254e-1942-4f54-9281-6142fd45e31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:28.765050 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2afa12b6-31da-43e8-bb57-9686da555bad tempest-VolumesTransfersV355Test-1342769664 None] Created volume successfully.
Apr 02 21:13:28.814122 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:13:28.815273 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:28.871137 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:28.898503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:29.663157 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-193272a1-7851-4745-a370-8b2a84ffcb6f tempest-GroupsTest-177939402 None] Update group completed successfully.
Apr 02 21:13:30.043883 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Lock "b'cinder-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:30.088597 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:30.172420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:30.172985 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Volume volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:30.182428 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] deleting rbd volume volume-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:30.533671 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Created reservations ['4485e688-99b2-4453-a780-af19fe03908b', '878e7681-02c8-46b8-bddd-328635457499', '52216a3a-479d-4086-9e11-5ddfe54159c3', '19cc81e0-a419-417e-a8f9-fa55f1e4e982'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:30.604624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:30.674000 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:30.731630 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:30.735686 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Deleted volume successfully.
Apr 02 21:13:30.756377 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ec405297-e7a7-4188-b103-01b990f1c18a tempest-VolumesTransfersV355Test-122621544 None] Lock "b'cinder-ec01d1ea-5441-4bd9-9e65-8c2a563cdb87-delete_volume'" released by "delete_volume" :: held 0.712s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:31.312134 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:31.403471 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:31.403950 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Volume volume-0174e9ea-04d3-4e3a-b393-621a11d10102 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:31.420972 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] deleting rbd volume volume-0174e9ea-04d3-4e3a-b393-621a11d10102 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:31.825229 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:31.897808 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:31.898535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Volume volume-a09e1e48-225b-42f7-900d-8663dfaa46ae is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:31.907566 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] deleting rbd volume volume-a09e1e48-225b-42f7-900d-8663dfaa46ae {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:32.278663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Created reservations ['878ee73e-c3ec-46de-bc2a-2e6acfd0c41c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:32.310201 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-370612908 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-370612908, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:32.312133 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-370612908 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-370612908, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:32.327725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Created reservations ['75701a9e-7442-4b46-ad2d-d9030a3689a8', '0549004d-ae9d-4614-b48b-56cff5305072', '3858dafc-15f4-44b2-bbac-152447ef5ce1', '3c19e251-9e5a-47eb-86b6-b424477e84de'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:32.501853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Created reservations ['bdc3d184-70fa-47ed-bb10-1459815292e2', 'f521d88a-cea6-482d-b017-74744fd7039e', 'cfb5cbee-fa27-4a92-bbcb-262d8611c2a8', '0195e4ed-089a-4400-9371-f497c39a8e9a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:32.636490 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:32.694562 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:32.762451 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:32.766811 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a1814238-80df-44ea-b410-8cbebf50b9e0 tempest-GroupsTest-177939402 None] Delete group completed successfully.
Apr 02 21:13:34.129518 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:34.150313 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Flow 'volume_create_manager' (20c5ce0e-9338-45a0-a60e-1044f10d8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:34.158192 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc27528-c5a8-45ce-ad1a-649bf132085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.174561 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc27528-c5a8-45ce-ad1a-649bf132085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1080756692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c8a309c-75cb-46df-bf99-a3214cd86e00,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ae86e9285c945628bacc57d4a745c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:34Z,use_quota=True,user_id='5f2d73016d7e493cb363cd993675b7ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.181064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d509ff-5dda-4d34-b7d0-76fa4ff5e582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.185759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d509ff-5dda-4d34-b7d0-76fa4ff5e582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.191178 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff20069-b09e-4f9c-9dfc-ab68ae2a99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.195622 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff20069-b09e-4f9c-9dfc-ab68ae2a99c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c8a309c-75cb-46df-bf99-a3214cd86e00', 'volume_name': 'volume-6c8a309c-75cb-46df-bf99-a3214cd86e00', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.201529 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479cd1dd-25c2-4ac6-a5fa-fd2c97f42352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.205872 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479cd1dd-25c2-4ac6-a5fa-fd2c97f42352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.211792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e514e9c-5c40-44a8-b14b-c5ca90e14b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.213188 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Volume 6c8a309c-75cb-46df-bf99-a3214cd86e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c8a309c-75cb-46df-bf99-a3214cd86e00', 'volume_size': 1}
Apr 02 21:13:34.213771 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] creating volume 'volume-6c8a309c-75cb-46df-bf99-a3214cd86e00' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:34.215539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:34.342110 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:34.342741 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:34.346877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e514e9c-5c40-44a8-b14b-c5ca90e14b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c8a309c-75cb-46df-bf99-a3214cd86e00', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.363851 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789368-5908-477d-bef2-a9914d9d84d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:34.377191 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Volume volume-6c8a309c-75cb-46df-bf99-a3214cd86e00 (6c8a309c-75cb-46df-bf99-a3214cd86e00): created successfully
Apr 02 21:13:34.381008 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a789368-5908-477d-bef2-a9914d9d84d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:34.387145 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Flow 'volume_create_manager' (20c5ce0e-9338-45a0-a60e-1044f10d8b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:34.407652 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-11c81ce3-cc76-4403-b614-2658acbf21ac req-4b9c979f-a1c1-44ae-be5b-0da36609b39b tempest-VolumesGetTestJSON-2091516914 None] Created volume successfully.
Apr 02 21:13:35.326345 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Lock "b'cinder-6c8a309c-75cb-46df-bf99-a3214cd86e00-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:35.385769 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:35.463094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:35.463661 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Volume volume-6c8a309c-75cb-46df-bf99-a3214cd86e00 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:35.473301 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] deleting rbd volume volume-6c8a309c-75cb-46df-bf99-a3214cd86e00 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:35.841652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Created reservations ['2aa540c3-454f-430d-8873-b6e1a8c674a2', '683f25b5-7e42-4626-a6cf-aaf7f30b1f33', '0830c46d-6478-44f3-84cc-058a2ac2abdb', '7c8c89e4-cebf-4d79-91b3-20ef229eb442'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:35.929109 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:35.981764 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:36.032094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:36.037868 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Deleted volume successfully.
Apr 02 21:13:36.063128 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-e540b28f-bfcb-494c-ab59-afbeebd89617 req-94bbe687-2f8e-4a46-aff2-5ce0755f76a0 tempest-VolumesGetTestJSON-2091516914 None] Lock "b'cinder-6c8a309c-75cb-46df-bf99-a3214cd86e00-delete_volume'" released by "delete_volume" :: held 0.737s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:36.474863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:36.536869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (b128b868-04fd-4480-aa7f-036615586898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:36.552958 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367e455d-0955-4e09-a953-27ff77a79308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.585373 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367e455d-0955-4e09-a953-27ff77a79308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-117474657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9269a2b6-cc9d-40b2-b86f-09d04ce54736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3265dbc2dbab442dbb562ef4a3652650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:36Z,use_quota=True,user_id='b80790d4e9484dfd92f9ad7e840637c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.608252 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dafe0bc-11d7-4e95-a04f-2a33de52f7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.614342 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dafe0bc-11d7-4e95-a04f-2a33de52f7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.625844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37d9e1f-504b-49ac-9d88-d97adabaa4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.635907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e37d9e1f-504b-49ac-9d88-d97adabaa4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'volume_name': 'volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.643553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e01c8-58f8-47bb-aece-8f74657a2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.649724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e01c8-58f8-47bb-aece-8f74657a2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.657602 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3e08da-1f1c-41de-93a4-3bc4bd7a6e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.660758 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Volume 9269a2b6-cc9d-40b2-b86f-09d04ce54736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'volume_size': 1}
Apr 02 21:13:36.661480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] creating volume 'volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:36.662607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:36.782471 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:36.783061 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:36.788343 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3e08da-1f1c-41de-93a4-3bc4bd7a6e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.793712 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a9ba34-2e2c-461e-bce9-5ea5683a0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:36.808670 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Volume volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736 (9269a2b6-cc9d-40b2-b86f-09d04ce54736): created successfully
Apr 02 21:13:36.816859 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a9ba34-2e2c-461e-bce9-5ea5683a0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:36.824339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (b128b868-04fd-4480-aa7f-036615586898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:36.852810 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3b7d6442-6f9f-414a-ad95-db025bb2d9bf tempest-VolumesBackupsTest-990025423 None] Created volume successfully.
Apr 02 21:13:47.370841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:47.397024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Flow 'volume_create_manager' (9c243df8-fad2-4417-9741-70f1563f1669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:47.407267 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56458b7-ab97-4ae0-bed6-a67cd0272a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.423411 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56458b7-ab97-4ae0-bed6-a67cd0272a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1976194573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=687e80a0-f206-4fd2-bc3d-2067d5c44613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba5069f9c1a14903acb26267457acaae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:47Z,use_quota=True,user_id='1d6710ca23ed41acad0f8338b61cd42b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(197241ee-a883-4709-ac07-20830299215c),volume_type_id=197241ee-a883-4709-ac07-20830299215c)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.429089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae506035-fa34-44cb-b19d-ee8226554991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.434322 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae506035-fa34-44cb-b19d-ee8226554991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.440037 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c7a677-e8d9-47a1-adfb-fefa1a43b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.444130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c7a677-e8d9-47a1-adfb-fefa1a43b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687e80a0-f206-4fd2-bc3d-2067d5c44613', 'volume_name': 'volume-687e80a0-f206-4fd2-bc3d-2067d5c44613', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.449147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d483c58-f2c2-4734-be55-8aea8a87a52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.453290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d483c58-f2c2-4734-be55-8aea8a87a52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.458990 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c53dbb1-e972-4bee-b41d-73c36453e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.460295 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Volume 687e80a0-f206-4fd2-bc3d-2067d5c44613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687e80a0-f206-4fd2-bc3d-2067d5c44613', 'volume_size': 1}
Apr 02 21:13:47.460905 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] creating volume 'volume-687e80a0-f206-4fd2-bc3d-2067d5c44613' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:47.461788 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:47.556822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:47.557217 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:47.561059 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c53dbb1-e972-4bee-b41d-73c36453e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687e80a0-f206-4fd2-bc3d-2067d5c44613', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.565690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee11a6b-d51c-4c99-94dc-6cdc9f8529d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:47.575673 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Volume volume-687e80a0-f206-4fd2-bc3d-2067d5c44613 (687e80a0-f206-4fd2-bc3d-2067d5c44613): created successfully
Apr 02 21:13:47.579528 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee11a6b-d51c-4c99-94dc-6cdc9f8529d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:47.593482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Flow 'volume_create_manager' (9c243df8-fad2-4417-9741-70f1563f1669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:47.606433 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-55f4617f-183f-4404-88aa-2403735c5f35 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Created volume successfully.
Apr 02 21:13:48.789678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fdd256fb-cbeb-40dd-a38c-637c909328c3 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:48.859322 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fdd256fb-cbeb-40dd-a38c-637c909328c3 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:48.900639 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-fdd256fb-cbeb-40dd-a38c-637c909328c3 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:48.905602 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fdd256fb-cbeb-40dd-a38c-637c909328c3 tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Retype volume completed successfully.
Apr 02 21:13:50.075661 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Lock "b'cinder-687e80a0-f206-4fd2-bc3d-2067d5c44613-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:50.180034 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:50.277062 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:13:50.277638 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Volume volume-687e80a0-f206-4fd2-bc3d-2067d5c44613 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:13:50.293863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] deleting rbd volume volume-687e80a0-f206-4fd2-bc3d-2067d5c44613 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:13:50.555626 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:50.557047 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:13:50.570495 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Created reservations ['41c0f95f-926f-4057-8619-1cbefbe92d57', '30813021-0d1e-4799-b740-ef0045bf9d06', '3dbc2fcc-6664-4652-8145-df85c4bb97ce', '17e680c3-7c7c-4813-9933-152efa45b4ee'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:13:50.618443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:50.669913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:50.705983 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:13:50.719435 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Deleted volume successfully.
Apr 02 21:13:50.737514 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a25f47b8-8b27-4003-a21e-d5de73ed915d tempest-VolumeRetypeWithoutMigrationTest-75140697 None] Lock "b'cinder-687e80a0-f206-4fd2-bc3d-2067d5c44613-delete_volume'" released by "delete_volume" :: held 0.663s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:13:55.555310 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8751b502-b51b-44c8-9d61-30704dedcc78 req-488c1d61-94fa-4a55-b102-d7c991fea047 tempest-VolumesBackupsTest-990025423 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:13:56.389558 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:13:56.416067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Flow 'volume_create_manager' (34c5989a-c1f7-43ee-8c1e-8c9f76338584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:56.425691 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36409f-b0e6-4123-8d88-fc01616f5d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.451006 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36409f-b0e6-4123-8d88-fc01616f5d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:13:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-281355431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5e890caf-99a2-4ed9-9db3-6457895d1655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f225bd13fc8c4322bda129069fb71d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:13:56Z,use_quota=True,user_id='33e309d018fc4bc0a4ca5ff0e0311e40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.461700 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8a601-d73a-4338-bb27-c70404b99a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.468810 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8a601-d73a-4338-bb27-c70404b99a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.478225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e4fef1-6014-45c0-a141-465de9cbff6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.485729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e4fef1-6014-45c0-a141-465de9cbff6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e890caf-99a2-4ed9-9db3-6457895d1655', 'volume_name': 'volume-5e890caf-99a2-4ed9-9db3-6457895d1655', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.496187 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fe3b86-4fb8-4a4a-b874-7e35aa79fff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.513712 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fe3b86-4fb8-4a4a-b874-7e35aa79fff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.525195 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5464c1-3746-420f-a441-b999727bc5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.526346 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Volume 5e890caf-99a2-4ed9-9db3-6457895d1655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e890caf-99a2-4ed9-9db3-6457895d1655', 'volume_size': 1}
Apr 02 21:13:56.526756 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] creating volume 'volume-5e890caf-99a2-4ed9-9db3-6457895d1655' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:13:56.528381 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:56.571132 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8751b502-b51b-44c8-9d61-30704dedcc78 req-488c1d61-94fa-4a55-b102-d7c991fea047 tempest-VolumesBackupsTest-990025423 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.016s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:13:56.572014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8751b502-b51b-44c8-9d61-30704dedcc78 req-488c1d61-94fa-4a55-b102-d7c991fea047 tempest-VolumesBackupsTest-990025423 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:13:56.617653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8751b502-b51b-44c8-9d61-30704dedcc78 req-488c1d61-94fa-4a55-b102-d7c991fea047 tempest-VolumesBackupsTest-990025423 None] Connection info returned from driver {'name': 'volumes/volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c66c1ed0-a8a4-46d7-b074-e59aec210dc1'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:13:56.667872 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:13:56.670465 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:13:56.677510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5464c1-3746-420f-a441-b999727bc5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e890caf-99a2-4ed9-9db3-6457895d1655', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.688830 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3244609-45a3-461c-ac2d-5e781742a7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:13:56.720490 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Volume volume-5e890caf-99a2-4ed9-9db3-6457895d1655 (5e890caf-99a2-4ed9-9db3-6457895d1655): created successfully
Apr 02 21:13:56.726784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3244609-45a3-461c-ac2d-5e781742a7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:13:56.735338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Flow 'volume_create_manager' (34c5989a-c1f7-43ee-8c1e-8c9f76338584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:13:56.749201 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3745a604-52eb-416d-90a6-9d98b97b2a7c tempest-SnapshotMetadataTestJSON-163907935 None] Created volume successfully.
Apr 02 21:13:56.756978 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8751b502-b51b-44c8-9d61-30704dedcc78 req-488c1d61-94fa-4a55-b102-d7c991fea047 tempest-VolumesBackupsTest-990025423 None] attachment_update completed successfully.
Apr 02 21:13:57.674618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f85bb804-0a07-4daf-9b71-6cb16829704f tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:13:58.540334 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f85bb804-0a07-4daf-9b71-6cb16829704f tempest-SnapshotMetadataTestJSON-163907935 None] Create snapshot completed successfully
Apr 02 21:13:59.065942 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:13:58Z,data_timestamp=2022-04-02T21:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1066010717',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=571723a0-981b-48cd-b10b-5b7e41cd9630,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3265dbc2dbab442dbb562ef4a3652650',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80790d4e9484dfd92f9ad7e840637c3',volume_id=9269a2b6-cc9d-40b2-b86f-09d04ce54736)
Apr 02 21:13:59.066966 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] continue_backup in rpcapi backup_id 571723a0-981b-48cd-b10b-5b7e41cd9630 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:13:59.348872 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:13:59.626971 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-59aa2972-ea11-40c6-9dff-62e8baf62aa7 tempest-SnapshotMetadataTestJSON-163907935 None] Lock "b'cinder-27fc88f3-1a3b-42a4-8ace-ecfca3d580f3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.038s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:13:59.635659 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-59aa2972-ea11-40c6-9dff-62e8baf62aa7 tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:00.520771 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.172s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:14:00.521620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '9269a2b6-cc9d-40b2-b86f-09d04ce54736', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:14:00.535939 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] Initialize volume connection completed successfully.
Apr 02 21:14:00.827849 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-59aa2972-ea11-40c6-9dff-62e8baf62aa7 tempest-SnapshotMetadataTestJSON-163907935 None] Created reservations ['2e68adcf-78f6-418a-bc59-c66babe1f92a', '8a3efcb8-38aa-486f-9c16-b55b8a950a8f', 'a3c94669-453c-40d2-9908-c36f3acc5c16', 'e5c3d039-cd6c-4010-97ec-7c57a11f3d6b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:00.867692 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-59aa2972-ea11-40c6-9dff-62e8baf62aa7 tempest-SnapshotMetadataTestJSON-163907935 None] Delete snapshot completed successfully.
Apr 02 21:14:00.872947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-59aa2972-ea11-40c6-9dff-62e8baf62aa7 tempest-SnapshotMetadataTestJSON-163907935 None] Lock "b'cinder-27fc88f3-1a3b-42a4-8ace-ecfca3d580f3-delete_snapshot'" released by "delete_snapshot" :: held 1.253s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:01.819355 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Lock "b'cinder-5e890caf-99a2-4ed9-9db3-6457895d1655-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:01.915132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:02.010622 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:02.011549 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Volume volume-5e890caf-99a2-4ed9-9db3-6457895d1655 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:02.026108 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] deleting rbd volume volume-5e890caf-99a2-4ed9-9db3-6457895d1655 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:02.478352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Created reservations ['c022a90c-3bdd-494d-9458-4f05c94c5ace', '31fbdb45-c81b-488a-83b8-cfacbf02d5d1', '6a0acfdc-818b-4862-aecd-7a7dd41186a0', '840e097b-c1e4-4dee-a493-1d8658e2cd48'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:02.561295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:02.652389 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:02.711898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:02.717076 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Deleted volume successfully.
Apr 02 21:14:02.732746 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0381e02e-ac3e-4e5a-a0ce-ef89284fd839 tempest-SnapshotMetadataTestJSON-163907935 None] Lock "b'cinder-5e890caf-99a2-4ed9-9db3-6457895d1655-delete_volume'" released by "delete_volume" :: held 0.913s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:03.011575 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] Terminate volume connection completed successfully.
Apr 02 21:14:03.052087 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73941536-a506-473d-a267-e03bdef2c5ee tempest-VolumesBackupsTest-990025423 None] Remove volume export completed successfully.
Apr 02 21:14:06.166431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:06.196570 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Flow 'volume_create_manager' (c139a5a2-0037-42e6-8647-2ac47906ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:06.204768 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdfec40-9ce4-449b-87ce-dc4d2351a4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:06.222869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdfec40-9ce4-449b-87ce-dc4d2351a4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-13715859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=46f2908f-dfa8-44bf-82f5-0faef30c1e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752dbe7fcf844bb881addb074467167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:06Z,use_quota=True,user_id='d74819209d5f45a5ae75ba6e5c9429b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:06.230784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b15bc1-76b2-4f95-b280-1ae33528a054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:06.236144 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b15bc1-76b2-4f95-b280-1ae33528a054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:06.243327 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ebbf09-32fa-41d5-9a93-3a72e9ea0e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:06.381367 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ebbf09-32fa-41d5-9a93-3a72e9ea0e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46f2908f-dfa8-44bf-82f5-0faef30c1e90', 'volume_name': 'volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953f8ee0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:06.387576 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cc478-8f1f-484f-a885-a64c09007007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:06.397015 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cc478-8f1f-484f-a885-a64c09007007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:06.402704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3475f6-c8ff-49e9-ae9c-07b761db0935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:06.403887 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Volume 46f2908f-dfa8-44bf-82f5-0faef30c1e90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953f8ee0>}
Apr 02 21:14:06.404508 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Cloning 46f2908f-dfa8-44bf-82f5-0faef30c1e90 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:14:06.415574 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:06.432472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 14, 6, 421667)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:14:06.432946 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:14:06.433396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:14:06.438756 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:06.440435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:14:06.456195 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 14, 6, 453193)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:14:06.456716 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:14:06.457165 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:14:06.471567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:06.551491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] creating snapshot='volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:14:07.638853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90.clone_snap' to 'volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:14:07.657937 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d req-0634ca40-d044-4c94-afe1-2b39b275c4e1 tempest-VolumesBackupsTest-990025423 None] Terminate volume connection completed successfully.
Apr 02 21:14:07.658549 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-eed6432e-f6e6-40c6-b3af-0a699f4a7f1d req-0634ca40-d044-4c94-afe1-2b39b275c4e1 tempest-VolumesBackupsTest-990025423 None] Deleting attachment c66c1ed0-a8a4-46d7-b074-e59aec210dc1. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:14:07.839479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:07.840882 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:07.841573 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:07.869719 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:14:07.872023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Marking volume 46f2908f-dfa8-44bf-82f5-0faef30c1e90 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:14:07.888857 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 46f2908f-dfa8-44bf-82f5-0faef30c1e90. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:14:07.890111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Creating volume glance metadata for volume 46f2908f-dfa8-44bf-82f5-0faef30c1e90 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:14:08.019854 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3475f6-c8ff-49e9-ae9c-07b761db0935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2953f8ee0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:08.026669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add4be8c-d152-423c-ab0b-c4b87442db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:08.040177 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Volume volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90 (46f2908f-dfa8-44bf-82f5-0faef30c1e90): created successfully
Apr 02 21:14:08.044278 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add4be8c-d152-423c-ab0b-c4b87442db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:08.050973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Flow 'volume_create_manager' (c139a5a2-0037-42e6-8647-2ac47906ea85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:08.061596 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b9eb09f4-e55e-4f3d-90f4-d8ff44e38539 tempest-VolumesExtendTest-559894001 None] Created volume successfully.
Apr 02 21:14:08.474378 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1bdcd4eb-c411-4ab0-ad5a-b9bb081389ac tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:08.710217 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1bdcd4eb-c411-4ab0-ad5a-b9bb081389ac tempest-VolumesExtendTest-559894001 None] Extend volume from 1 GB to 2 GB. {{(pid=129783) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}}
Apr 02 21:14:08.755336 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1bdcd4eb-c411-4ab0-ad5a-b9bb081389ac tempest-VolumesExtendTest-559894001 None] Extend volume completed successfully.
Apr 02 21:14:10.144394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:10.166841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Flow 'volume_create_manager' (bdeb2ade-f9e6-49ae-9e48-57e067317ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:10.173824 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded400bc-d21f-4d6b-a922-e51241ac4087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.189992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded400bc-d21f-4d6b-a922-e51241ac4087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-434808680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='752dbe7fcf844bb881addb074467167e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:10Z,use_quota=True,user_id='d74819209d5f45a5ae75ba6e5c9429b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.195669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b0327-e986-4c3a-b1dd-af8efe6aecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.200096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e00b0327-e986-4c3a-b1dd-af8efe6aecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.205778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5955a221-b965-4cb3-a861-74c7a1b122d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.210756 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5955a221-b965-4cb3-a861-74c7a1b122d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c', 'volume_name': 'volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.215994 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f711ed-3369-46ac-81ca-4c45f4cf5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.220353 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f711ed-3369-46ac-81ca-4c45f4cf5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.226577 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d38d56-a2db-48ff-b9e8-044ef1fa89dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.227939 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Volume 3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c', 'volume_size': 1}
Apr 02 21:14:10.228408 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] creating volume 'volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:14:10.229335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:10.319020 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:10.319434 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:10.324010 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d38d56-a2db-48ff-b9e8-044ef1fa89dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.329300 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de030da7-a064-48f6-bfc8-4c0fdb9a635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:10.349998 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Volume volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c (3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c): created successfully
Apr 02 21:14:10.354446 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de030da7-a064-48f6-bfc8-4c0fdb9a635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:10.360637 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Flow 'volume_create_manager' (bdeb2ade-f9e6-49ae-9e48-57e067317ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:10.383380 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-45672bb1-61a1-4234-9c7f-6456ba27d7cf tempest-VolumesExtendTest-559894001 None] Created volume successfully.
Apr 02 21:14:11.464493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8e0af591-490e-4e6a-9937-72a4e9f8bf11 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:12.115586 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-9269a2b6-cc9d-40b2-b86f-09d04ce54736-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:12.179696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:12.387069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Volume volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:12.416774 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] deleting rbd volume volume-9269a2b6-cc9d-40b2-b86f-09d04ce54736 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:12.526792 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8e0af591-490e-4e6a-9937-72a4e9f8bf11 tempest-VolumesExtendTest-559894001 None] Create snapshot completed successfully
Apr 02 21:14:12.759257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Created reservations ['11902004-35c5-42c2-97dd-26c857f11797', 'b6ca1bfa-5faf-4616-bb3a-25dd440e0c38', '5e72b466-ee2e-4c48-ab51-c20c7b3659e9', 'e18b80a9-38b0-4c23-a4fb-6ee0fc8d0f15'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:12.826230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:12.866547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:12.924435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:12.933555 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Deleted volume successfully.
Apr 02 21:14:12.954096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-37f33d29-e67f-4cf0-ac5c-47d9105855ad tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-9269a2b6-cc9d-40b2-b86f-09d04ce54736-delete_volume'" released by "delete_volume" :: held 0.839s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:13.768595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-42472b4b-f7e3-469b-8360-fdffa0cc3962 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:13.922879 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:13.952625 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (aa07a713-dfcf-435f-bdb8-f007a9b4bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:13.963390 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35507a9c-74f5-4d2f-b3d9-904ae323e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:13.975130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-42472b4b-f7e3-469b-8360-fdffa0cc3962 tempest-VolumesExtendTest-559894001 None] Extend volume from 1 GB to 2 GB. {{(pid=129783) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1874}}
Apr 02 21:14:13.991225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35507a9c-74f5-4d2f-b3d9-904ae323e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-678055519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0719ac9f-ffc0-414d-823e-794906e1ac85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3265dbc2dbab442dbb562ef4a3652650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:14Z,use_quota=True,user_id='b80790d4e9484dfd92f9ad7e840637c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:13.997522 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8325f4a-7577-437a-ae8e-bdebf37b49f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:14.001685 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8325f4a-7577-437a-ae8e-bdebf37b49f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:14.009236 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d632c119-c8c0-4a32-8684-b8fab22d9781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:14.070393 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-42472b4b-f7e3-469b-8360-fdffa0cc3962 tempest-VolumesExtendTest-559894001 None] Extend volume completed successfully.
Apr 02 21:14:14.111926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d632c119-c8c0-4a32-8684-b8fab22d9781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0719ac9f-ffc0-414d-823e-794906e1ac85', 'volume_name': 'volume-0719ac9f-ffc0-414d-823e-794906e1ac85', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295519400>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:14.117328 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f85eb9-8267-4691-ad39-23a1ff6a6263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:14.122124 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f85eb9-8267-4691-ad39-23a1ff6a6263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:14.127861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a974c-f607-4496-91db-3ced4e435c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:14.129332 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Volume 0719ac9f-ffc0-414d-823e-794906e1ac85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0719ac9f-ffc0-414d-823e-794906e1ac85', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295519400>}
Apr 02 21:14:14.130276 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Cloning 0719ac9f-ffc0-414d-823e-794906e1ac85 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:14:14.141489 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:14.152954 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 14, 14, 145461)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:14:14.153470 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:14:14.153996 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:14:14.158616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:14.159690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:14:14.166562 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 14, 14, 164182)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:14:14.166976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:14:14.167415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:14:14.179555 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:14.278472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] creating snapshot='volume-0719ac9f-ffc0-414d-823e-794906e1ac85.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:14:14.780202 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-0719ac9f-ffc0-414d-823e-794906e1ac85.clone_snap' to 'volume-0719ac9f-ffc0-414d-823e-794906e1ac85' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:14:15.015747 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:15.016875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:15.017258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:15.051977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:14:15.052827 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Marking volume 0719ac9f-ffc0-414d-823e-794906e1ac85 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:14:15.088597 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 0719ac9f-ffc0-414d-823e-794906e1ac85. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:14:15.090173 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Creating volume glance metadata for volume 0719ac9f-ffc0-414d-823e-794906e1ac85 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:14:15.100530 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-75341f58-ae0d-403d-93cf-3e6ae4df54b8 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-f962b207-06f3-4a88-a3f2-dc2e3e2fec01-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.039s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:15.105041 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-75341f58-ae0d-403d-93cf-3e6ae4df54b8 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:15.299633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0a974c-f607-4496-91db-3ced4e435c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0719ac9f-ffc0-414d-823e-794906e1ac85', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295519400>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:15.304808 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a0bd0d-1ca7-4e85-92b6-fe7f605f6273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:15.315407 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Volume volume-0719ac9f-ffc0-414d-823e-794906e1ac85 (0719ac9f-ffc0-414d-823e-794906e1ac85): created successfully
Apr 02 21:14:15.320084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a0bd0d-1ca7-4e85-92b6-fe7f605f6273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:15.326026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (aa07a713-dfcf-435f-bdb8-f007a9b4bf42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:15.337076 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-310909b9-8a0a-4af8-8f4d-f61a760e7174 tempest-VolumesBackupsTest-990025423 None] Created volume successfully.
Apr 02 21:14:15.860841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-75341f58-ae0d-403d-93cf-3e6ae4df54b8 tempest-VolumesExtendTest-559894001 None] Created reservations ['910c473a-edd3-4b46-8a73-901397dfaadd', '6e25febb-7a12-4fff-9da1-0131a28d779b', '4b1836f7-b0fe-41f0-ab72-a249d2ae3adc', 'c53694ad-ffa2-4780-9627-67546aea7efb'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:15.932107 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-75341f58-ae0d-403d-93cf-3e6ae4df54b8 tempest-VolumesExtendTest-559894001 None] Delete snapshot completed successfully.
Apr 02 21:14:15.937936 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-75341f58-ae0d-403d-93cf-3e6ae4df54b8 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-f962b207-06f3-4a88-a3f2-dc2e3e2fec01-delete_snapshot'" released by "delete_snapshot" :: held 0.838s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:16.176331 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:16.214072 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:14:16Z,data_timestamp=2022-04-02T21:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1999085688',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c0fa9c74-c64b-42ce-84a0-fb850cace5c9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='3265dbc2dbab442dbb562ef4a3652650',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='b80790d4e9484dfd92f9ad7e840637c3',volume_id=0719ac9f-ffc0-414d-823e-794906e1ac85)
Apr 02 21:14:16.214818 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] continue_backup in rpcapi backup_id c0fa9c74-c64b-42ce-84a0-fb850cace5c9 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:14:16.246024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:16.337651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:16.339152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Volume volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:16.351318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] deleting rbd volume volume-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:16.532968 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:14:16.765772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Created reservations ['8549fe1b-6701-48bb-9144-15293368e501', 'b0abe2dc-19fc-48c2-b652-d92c888e629c', 'a1991f71-64e6-49d5-8dc4-00a7d9a9afd4', '9cba12e9-6213-4746-9290-2f2ec2a70a26'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:16.833494 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:16.903327 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:16.976108 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:16.991303 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Deleted volume successfully.
Apr 02 21:14:17.010559 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9b118c4b-5325-4a14-9f56-3dc15e903364 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-3dcf5247-dcd4-45fd-8b38-098bfd0e6a6c-delete_volume'" released by "delete_volume" :: held 0.836s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:17.383981 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-46f2908f-dfa8-44bf-82f5-0faef30c1e90-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:17.422801 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.890s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:14:17.426303 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0719ac9f-ffc0-414d-823e-794906e1ac85', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '0719ac9f-ffc0-414d-823e-794906e1ac85', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:14:17.471997 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:17.565372 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:17.574263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] deleting rbd volume volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:17.575673 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] Initialize volume connection completed successfully.
Apr 02 21:14:17.924107 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:14:17.977650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] deleting parent snapshot volume-46f2908f-dfa8-44bf-82f5-0faef30c1e90.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:14:18.850738 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] Created reservations ['d816a94c-d614-4f93-be75-932076f1b436', '8c30de24-1501-4070-8e9d-4b0500d7856d', '87463b34-79a1-4dfa-ae2e-8d8c84d1ce3b', 'ca23d0a4-e283-4397-9c3b-06b528c3007a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:18.954282 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:19.027221 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:19.072472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:19.076630 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] Deleted volume successfully.
Apr 02 21:14:19.092499 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f76dd18d-928a-4470-96ef-44b6b17e7eb2 tempest-VolumesExtendTest-559894001 None] Lock "b'cinder-46f2908f-dfa8-44bf-82f5-0faef30c1e90-delete_volume'" released by "delete_volume" :: held 1.709s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:25.159679 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:25.198717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (f5f9be28-9b53-49f4-96d4-80d238f7285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:25.206882 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ed76f-748a-412c-8028-7c4f26d439e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.243327 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0ed76f-748a-412c-8028-7c4f26d439e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-381328371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c87f93d6-de80-42a3-9d17-3629759f6c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:25Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.253343 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfa5acd-2c78-4fdd-85d6-71f12240521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.260483 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfa5acd-2c78-4fdd-85d6-71f12240521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.292341 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb9b0b-3101-40b4-95e1-12e1c32a53eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.297473 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edb9b0b-3101-40b4-95e1-12e1c32a53eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87f93d6-de80-42a3-9d17-3629759f6c8b', 'volume_name': 'volume-c87f93d6-de80-42a3-9d17-3629759f6c8b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.303634 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca8ecbf-1268-4acb-8d06-7e9e54d81d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.309429 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca8ecbf-1268-4acb-8d06-7e9e54d81d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.315730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b42d1b-22fa-41ff-96d8-5c38ea4ab563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.317198 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Volume c87f93d6-de80-42a3-9d17-3629759f6c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87f93d6-de80-42a3-9d17-3629759f6c8b', 'volume_size': 1}
Apr 02 21:14:25.317762 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] creating volume 'volume-c87f93d6-de80-42a3-9d17-3629759f6c8b' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:14:25.318991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:25.767765 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:25.768399 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:25.774407 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b42d1b-22fa-41ff-96d8-5c38ea4ab563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87f93d6-de80-42a3-9d17-3629759f6c8b', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.795952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7410b914-a5b3-4210-a026-ef8502898ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:25.807185 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-c87f93d6-de80-42a3-9d17-3629759f6c8b (c87f93d6-de80-42a3-9d17-3629759f6c8b): created successfully
Apr 02 21:14:25.813427 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7410b914-a5b3-4210-a026-ef8502898ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:25.844427 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (f5f9be28-9b53-49f4-96d4-80d238f7285d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:25.866678 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-74fc7f83-4fa7-4af5-b3c6-1403d574d59a tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:14:26.646127 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0dd3522f-859d-4811-aa9a-67829e975e84 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:27.447692 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-4d98a5ad-74b8-428c-8004-63f7ff03c292 req-381e7cca-c184-45ad-b174-94727cb8f54f tempest-ServerRescueNegativeTestJSON-1832764052 None] Terminate volume connection completed successfully.
Apr 02 21:14:27.448677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-4d98a5ad-74b8-428c-8004-63f7ff03c292 req-381e7cca-c184-45ad-b174-94727cb8f54f tempest-ServerRescueNegativeTestJSON-1832764052 None] Deleting attachment f61542f6-719b-482c-9cd7-ddd8709bb570. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:14:27.742100 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0dd3522f-859d-4811-aa9a-67829e975e84 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:14:27.902807 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] Terminate volume connection completed successfully.
Apr 02 21:14:27.946757 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9f207119-fb13-48a3-8e6d-1314ade522a7 tempest-VolumesBackupsTest-990025423 None] Remove volume export completed successfully.
Apr 02 21:14:28.819773 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:14:28.820491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:28.885616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:28.954884 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:29.288313 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.driver [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Creating a new backup for volume volume-c87f93d6-de80-42a3-9d17-3629759f6c8b. {{(pid=129783) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1212}}
Apr 02 21:14:29.358757 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] cloning volumes/volume-c87f93d6-de80-42a3-9d17-3629759f6c8b@snapshot-4c2685a2-a52a-4e3c-8955-33dada66c326 to volume-e1774229-73a8-44bb-b628-dc596f4722d2 {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:14:29.361637 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:29.466362 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:29.586147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:29.614205 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (885c5861-a44f-45b1-b5b8-a1efd440c7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:29.630556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f424bba3-9eb5-4f79-844b-107a2bbf47b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.657097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f424bba3-9eb5-4f79-844b-107a2bbf47b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:29Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_c0fa9c74-c64b-42ce-84a0-fb850cace5c9',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=53aa51fa-494f-4726-ba3d-6510fd7e0a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3265dbc2dbab442dbb562ef4a3652650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:30Z,use_quota=True,user_id='b80790d4e9484dfd92f9ad7e840637c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.668987 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a959f086-fa88-4bc2-9844-ca998d6a8621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.677452 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a959f086-fa88-4bc2-9844-ca998d6a8621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.688479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab16d1d-46f9-4164-99e8-72a0252aa25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.695725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab16d1d-46f9-4164-99e8-72a0252aa25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'volume_name': 'volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.703854 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b281f6ed-e643-4aec-a4b2-4f60f18525f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.712413 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b281f6ed-e643-4aec-a4b2-4f60f18525f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.718666 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f38bbd8-e5a3-42ac-9e32-5061c1e0d5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.719870 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Volume 53aa51fa-494f-4726-ba3d-6510fd7e0a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'volume_size': 1}
Apr 02 21:14:29.720272 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] creating volume 'volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:14:29.721051 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:29.783664 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:29.784172 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:29.819831 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:14:28Z,data_timestamp=2022-04-02T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-1688307190',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=d77139f9-4985-42bf-8c9f-04be2be11db4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='4c2685a2-a52a-4e3c-8955-33dada66c326',status='creating',temp_snapshot_id=None,temp_volume_id='e1774229-73a8-44bb-b628-dc596f4722d2',updated_at=None,user_id='08aca3700d594a349789d5f3847894dc',volume_id=c87f93d6-de80-42a3-9d17-3629759f6c8b)
Apr 02 21:14:29.821514 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] continue_backup in rpcapi backup_id d77139f9-4985-42bf-8c9f-04be2be11db4 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:14:29.843839 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:29.844694 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:29.851212 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f38bbd8-e5a3-42ac-9e32-5061c1e0d5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.867406 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb74c9c9-aaca-45a7-9f6c-ef3cf37fd930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:29.885850 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Volume volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33 (53aa51fa-494f-4726-ba3d-6510fd7e0a33): created successfully
Apr 02 21:14:29.892917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb74c9c9-aaca-45a7-9f6c-ef3cf37fd930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:29.903003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Flow 'volume_create_manager' (885c5861-a44f-45b1-b5b8-a1efd440c7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:29.931624 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Created volume successfully.
Apr 02 21:14:30.158107 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:14:30.937672 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:14:31.899843 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.741s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:14:31.901594 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e1774229-73a8-44bb-b628-dc596f4722d2', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'e1774229-73a8-44bb-b628-dc596f4722d2', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:14:31.928735 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Initialize volume connection completed successfully.
Apr 02 21:14:32.311565 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.374s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:14:32.312314 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '53aa51fa-494f-4726-ba3d-6510fd7e0a33', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:14:32.333218 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Initialize volume connection completed successfully.
Apr 02 21:14:41.093266 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Lock "b'cinder-b42e54e9-c580-4f38-98f7-8ec72ff034bb-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:41.200100 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:41.328692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:41.329283 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:41.359618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] deleting rbd volume volume-b42e54e9-c580-4f38-98f7-8ec72ff034bb {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:42.184293 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Created reservations ['e890d907-4115-4950-96f0-7c0b55fb4743', 'f8c94b90-c67a-4a50-a458-2dfcc5007698', '2f0d20d2-4ce9-4eaf-ad34-689088e0a27c', '8465681c-2aaa-41fb-9542-4331d0c73699'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:42.299413 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:42.402852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:42.475380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:42.490705 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Deleted volume successfully.
Apr 02 21:14:42.503563 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Lock "b'cinder-c0a72472-a1aa-4b7e-a842-f0243245ada7-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:42.520652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3bd982a8-3ac2-4bbd-8a86-96b9fc6bb27b tempest-ServerRescueNegativeTestJSON-1832764052 None] Lock "b'cinder-b42e54e9-c580-4f38-98f7-8ec72ff034bb-delete_volume'" released by "delete_volume" :: held 1.427s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:42.582267 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:42.749718 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:42.750231 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Volume volume-c0a72472-a1aa-4b7e-a842-f0243245ada7 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:42.776102 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] deleting rbd volume volume-c0a72472-a1aa-4b7e-a842-f0243245ada7 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:43.337824 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Terminate volume connection completed successfully.
Apr 02 21:14:43.389846 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3462c51e-100e-4636-914f-3cb2044ba5c3 tempest-VolumesBackupsTest-990025423 None] Remove volume export completed successfully.
Apr 02 21:14:43.526149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Created reservations ['ee5d499c-1251-4955-807c-3e5023a4d7f5', 'fd0389a8-6524-45ac-968c-87780d734f47', '7bfd7fed-45bf-4c7a-9dda-fa95e2651896', '335514df-6950-47f1-9d6a-18e95a92160a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:43.664084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:43.762780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:43.844362 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:43.849792 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Deleted volume successfully.
Apr 02 21:14:43.878421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7aaa4e9a-6a6a-4734-a288-0157aaf60b8f tempest-ServerRescueNegativeTestJSON-1832764052 None] Lock "b'cinder-c0a72472-a1aa-4b7e-a842-f0243245ada7-delete_volume'" released by "delete_volume" :: held 1.374s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:44.596393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-53aa51fa-494f-4726-ba3d-6510fd7e0a33-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:44.673921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:45.651235 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Volume volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:14:45.754546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] deleting rbd volume volume-53aa51fa-494f-4726-ba3d-6510fd7e0a33 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:47.404428 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Created reservations ['885aeab0-42f6-497e-ab48-6febca9e4bc6', '244d240e-c35b-4d7d-9693-819d1517cf30', '9f6802a9-52e4-4789-9231-dd5ce3a4125f', 'aea3c842-d1ee-4b3f-a75f-2aba49152f73'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:47.524611 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:47.597103 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:47.675084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:47.680952 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Deleted volume successfully.
Apr 02 21:14:47.712704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-19eac7a0-7239-4356-8d98-d148784312d1 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-53aa51fa-494f-4726-ba3d-6510fd7e0a33-delete_volume'" released by "delete_volume" :: held 3.115s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:50.237724 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Terminate volume connection completed successfully.
Apr 02 21:14:50.260124 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Remove volume export completed successfully.
Apr 02 21:14:50.335872 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-e1774229-73a8-44bb-b628-dc596f4722d2-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:50.361673 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:50.470460 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:14:50.486120 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-e1774229-73a8-44bb-b628-dc596f4722d2 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:50.862912 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:14:50.870179 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-eabbc36e-3e70-44f3-8612-060b1b9d17b0 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-e1774229-73a8-44bb-b628-dc596f4722d2-delete_volume'" released by "delete_volume" :: held 0.534s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:51.440578 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-0719ac9f-ffc0-414d-823e-794906e1ac85-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:14:51.518539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:52.836786 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] deleting rbd volume volume-0719ac9f-ffc0-414d-823e-794906e1ac85 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:14:53.285730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:14:53.338549 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] deleting parent snapshot volume-0719ac9f-ffc0-414d-823e-794906e1ac85.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:14:54.021808 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] Created reservations ['255082c8-4be9-4454-a5c2-3af28d6579fe', 'cb13b5c0-12d5-41f4-893c-5fc9da3961c0', '8d16e1cb-404a-4a7c-b0a8-722ec996b073', 'f8aa7e36-d51e-41a8-a9dc-357918ff2895'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:14:54.111609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:54.172784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:54.219616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:14:54.228234 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] Deleted volume successfully.
Apr 02 21:14:54.243438 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b3790890-7263-46f5-92ce-1526e9d28173 tempest-VolumesBackupsTest-990025423 None] Lock "b'cinder-0719ac9f-ffc0-414d-823e-794906e1ac85-delete_volume'" released by "delete_volume" :: held 2.803s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:14:57.635753 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:14:57.656797 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Flow 'volume_create_manager' (6516f9ab-6dcd-41eb-8259-0b33cfc2363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:57.664400 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ac79de-4e67-45fc-a57a-529548c9df9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.690952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ac79de-4e67-45fc-a57a-529548c9df9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-54181626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f1bda071d042bfaa92c36f88a0582f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:14:58Z,use_quota=True,user_id='3ada81b2a79d458c807b333caddde24d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.698898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d5aff1-3a80-4d17-8752-4301b03d7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.703765 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d5aff1-3a80-4d17-8752-4301b03d7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.709546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfef90b-29e3-4b23-88ca-a4736fada8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.714063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfef90b-29e3-4b23-88ca-a4736fada8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'volume_name': 'volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.719953 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561f69f8-6b2b-470d-8242-c475c277283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.724269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561f69f8-6b2b-470d-8242-c475c277283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.729469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1068aa17-89ed-4405-85f1-09c5e265d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.730891 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Volume a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'volume_size': 1}
Apr 02 21:14:57.731778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] creating volume 'volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:14:57.733003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:14:57.815295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:14:57.815469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:14:57.830603 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1068aa17-89ed-4405-85f1-09c5e265d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.836163 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40b9d7-9e18-47f2-b1f2-066eb043d30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:14:57.851450 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Volume volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560 (a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560): created successfully
Apr 02 21:14:57.856991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40b9d7-9e18-47f2-b1f2-066eb043d30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:14:57.864683 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Flow 'volume_create_manager' (6516f9ab-6dcd-41eb-8259-0b33cfc2363a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:14:57.876244 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-126cb019-9df3-47e3-877a-eea19f30fdb5 tempest-VolumesBackupsV39Test-1741259811 None] Created volume successfully.
Apr 02 21:14:58.855378 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:14:58Z,data_timestamp=2022-04-02T21:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1290784737',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=e8186e17-2214-483f-8aed-135f277aecd4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='f1f1bda071d042bfaa92c36f88a0582f',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='3ada81b2a79d458c807b333caddde24d',volume_id=a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560)
Apr 02 21:14:58.856596 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] continue_backup in rpcapi backup_id e8186e17-2214-483f-8aed-135f277aecd4 {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:14:59.134676 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:15:00.157202 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.022s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:15:00.158143 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:15:00.177037 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] Initialize volume connection completed successfully.
Apr 02 21:15:02.168914 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] Terminate volume connection completed successfully.
Apr 02 21:15:02.201909 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2e274e4a-60b7-4d08-aae6-17b20eb2e634 tempest-VolumesBackupsV39Test-1741259811 None] Remove volume export completed successfully.
Apr 02 21:15:05.359044 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Lock "b'cinder-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:05.428723 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:06.074491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Volume volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:06.118706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] deleting rbd volume volume-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:06.631781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Created reservations ['f5392fed-5727-48d4-8fbb-19f16877ba5f', 'e2753511-a3c2-4be9-9066-948e6b0c4dad', 'aeaacdc2-6ca5-47f8-8937-8c04f7f3f433', '3e91d243-2846-4026-894d-440fb97db0e4'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:06.713352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:06.796360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:06.858218 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:06.867018 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Deleted volume successfully.
Apr 02 21:15:06.888808 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d71b2703-30dd-44b9-9bb1-5e6c5c82a520 tempest-VolumesBackupsV39Test-1741259811 None] Lock "b'cinder-a18a946b-4c4d-4ffd-8ca7-d1ccf4d98560-delete_volume'" released by "delete_volume" :: held 1.529s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:11.361580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:11.391907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (882e06c5-7b99-467b-bdaa-bd93884adf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:11.406602 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7276c397-dadd-4e8e-bfa5-336c9d5cadfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:11.428103 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7276c397-dadd-4e8e-bfa5-336c9d5cadfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-507343732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c4adb7a-3061-4726-9770-b03e1018f469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72eede125774117930b0fdb575ecb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:11Z,use_quota=True,user_id='e037b5b9cea44165ba2a586418e047f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:11.434789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a119c-b7f0-49a3-8153-7ff1ea3370bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:11.447100 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a119c-b7f0-49a3-8153-7ff1ea3370bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:11.461520 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2110178-cf6a-44bd-8426-24df7e8e24ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:11.571766 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2110178-cf6a-44bd-8426-24df7e8e24ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c4adb7a-3061-4726-9770-b03e1018f469', 'volume_name': 'volume-9c4adb7a-3061-4726-9770-b03e1018f469', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952f75e0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:11.578727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2233484f-729e-473d-a449-b2187d76fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:11.583302 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2233484f-729e-473d-a449-b2187d76fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:11.588447 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a679201-36b9-448b-85b7-3856025bdbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:11.589656 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Volume 9c4adb7a-3061-4726-9770-b03e1018f469: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c4adb7a-3061-4726-9770-b03e1018f469', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952f75e0>}
Apr 02 21:15:11.590238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Cloning 9c4adb7a-3061-4726-9770-b03e1018f469 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:15:11.602230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:11.622656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 15, 11, 611629)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:15:11.623357 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:15:11.623954 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:15:11.638076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:11.639708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:15:11.648181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 15, 11, 644712)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:15:11.649032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:15:11.649440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:15:11.666526 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:11.784900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] creating snapshot='volume-9c4adb7a-3061-4726-9770-b03e1018f469.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:15:12.445049 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-9c4adb7a-3061-4726-9770-b03e1018f469.clone_snap' to 'volume-9c4adb7a-3061-4726-9770-b03e1018f469' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:15:12.486283 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:12.537051 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (1ce8d551-e9c8-4801-b85b-8cfba5a7f55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:12.554411 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e847c0e-9db6-4e5a-87ca-e92730c9e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:12.587861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e847c0e-9db6-4e5a-87ca-e92730c9e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-621641638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8fe875f0-142e-4db8-8a87-f78692047798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:12Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:12.594618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33be7f07-6054-41bd-90c2-fd0b218ec789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:12.599907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33be7f07-6054-41bd-90c2-fd0b218ec789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:12.605933 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521534b3-f1e8-4b6e-90b2-00167bdeb89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:12.677728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:12.682166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:12.682669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:12.721403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:15:12.722919 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Marking volume 9c4adb7a-3061-4726-9770-b03e1018f469 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:15:12.763403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 9c4adb7a-3061-4726-9770-b03e1018f469. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:15:12.765200 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Creating volume glance metadata for volume 9c4adb7a-3061-4726-9770-b03e1018f469 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:15:12.839962 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521534b3-f1e8-4b6e-90b2-00167bdeb89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fe875f0-142e-4db8-8a87-f78692047798', 'volume_name': 'volume-8fe875f0-142e-4db8-8a87-f78692047798', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ed00>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:12.845591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec09c04-d55f-4308-844d-37582b90a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:12.849781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec09c04-d55f-4308-844d-37582b90a495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:12.854917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c4ec5b-bea0-405c-be0f-e04b8597a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:12.856130 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Volume 8fe875f0-142e-4db8-8a87-f78692047798: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fe875f0-142e-4db8-8a87-f78692047798', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ed00>}
Apr 02 21:15:12.856721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Cloning 8fe875f0-142e-4db8-8a87-f78692047798 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:15:12.874587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:12.888034 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 15, 12, 878222)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:15:12.888272 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:15:12.888539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:15:12.895393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:12.896092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:15:12.904263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 15, 12, 899487)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:15:12.904908 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:15:12.905224 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:15:12.918554 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:13.018838 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] creating snapshot='volume-8fe875f0-142e-4db8-8a87-f78692047798.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:15:13.494580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-8fe875f0-142e-4db8-8a87-f78692047798.clone_snap' to 'volume-8fe875f0-142e-4db8-8a87-f78692047798' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:15:13.533660 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a679201-36b9-448b-85b7-3856025bdbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4adb7a-3061-4726-9770-b03e1018f469', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952f75e0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:13.548186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc35b1bb-52c4-4738-b46e-2e4692cfaed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:13.565447 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Volume volume-9c4adb7a-3061-4726-9770-b03e1018f469 (9c4adb7a-3061-4726-9770-b03e1018f469): created successfully
Apr 02 21:15:13.570325 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc35b1bb-52c4-4738-b46e-2e4692cfaed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:13.577458 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (882e06c5-7b99-467b-bdaa-bd93884adf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:13.587805 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e0e0ba7f-80d3-4412-b271-13363b4feea2 tempest-VolumesCloneTest-386986046 None] Created volume successfully.
Apr 02 21:15:13.695436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:13.696569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:13.697157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:13.727265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:15:13.728237 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Marking volume 8fe875f0-142e-4db8-8a87-f78692047798 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:15:13.740365 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 8fe875f0-142e-4db8-8a87-f78692047798. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:15:13.741238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Creating volume glance metadata for volume 8fe875f0-142e-4db8-8a87-f78692047798 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:15:13.861818 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c4ec5b-bea0-405c-be0f-e04b8597a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe875f0-142e-4db8-8a87-f78692047798', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29534ed00>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:13.867071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048e63ff-6e76-4799-b822-39b0fa405480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:13.878909 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-8fe875f0-142e-4db8-8a87-f78692047798 (8fe875f0-142e-4db8-8a87-f78692047798): created successfully
Apr 02 21:15:13.882748 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048e63ff-6e76-4799-b822-39b0fa405480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:13.893307 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (1ce8d551-e9c8-4801-b85b-8cfba5a7f55d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:13.907606 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-41b53293-8b68-48a1-8b82-b4b73ac1da47 tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:15:15.181057 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b req-030946d0-c5a2-4518-99fe-d640dc595bea tempest-VolumesSnapshotTestJSON-244026219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:15:15.260988 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:15.302565 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (b21e173b-dafd-4932-b937-18229807eadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:15.317745 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce21f23-fb3e-431d-8cd7-d7e8b2bd6da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:15.336782 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce21f23-fb3e-431d-8cd7-d7e8b2bd6da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1813363144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=45b75797-22a1-4174-b01c-63b04d457e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72eede125774117930b0fdb575ecb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9c4adb7a-3061-4726-9770-b03e1018f469,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:15Z,use_quota=True,user_id='e037b5b9cea44165ba2a586418e047f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:15.342469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f8d7ba-23d2-40d2-bbcf-9af2138f0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:15.346737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6f8d7ba-23d2-40d2-bbcf-9af2138f0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:15.352105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969205c6-258c-4f54-87bb-f91ea9fed736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:15.373607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969205c6-258c-4f54-87bb-f91ea9fed736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '45b75797-22a1-4174-b01c-63b04d457e35', 'volume_name': 'volume-45b75797-22a1-4174-b01c-63b04d457e35', 'volume_size': 1, 'source_volid': '9c4adb7a-3061-4726-9770-b03e1018f469', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:15.381975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5a3257-ca4a-419d-bfe1-94d4ef443d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:15.401208 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5a3257-ca4a-419d-bfe1-94d4ef443d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:15.410963 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce2b3b-83f0-4d86-99c9-afd3e9002ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:15.412156 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Volume 45b75797-22a1-4174-b01c-63b04d457e35: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-45b75797-22a1-4174-b01c-63b04d457e35', 'volume_size': 1, 'source_volid': '9c4adb7a-3061-4726-9770-b03e1018f469', 'source_volstatus': 'available'}
Apr 02 21:15:15.426515 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:15.537108 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] creating snapshot='volume-45b75797-22a1-4174-b01c-63b04d457e35.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:15:16.549916 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] cloning 'volume-9c4adb7a-3061-4726-9770-b03e1018f469@volume-45b75797-22a1-4174-b01c-63b04d457e35.clone_snap' to 'volume-45b75797-22a1-4174-b01c-63b04d457e35' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:15:16.556584 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b req-030946d0-c5a2-4518-99fe-d640dc595bea tempest-VolumesSnapshotTestJSON-244026219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.376s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:15:16.557713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b req-030946d0-c5a2-4518-99fe-d640dc595bea tempest-VolumesSnapshotTestJSON-244026219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8fe875f0-142e-4db8-8a87-f78692047798', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '8fe875f0-142e-4db8-8a87-f78692047798', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:15:16.631462 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b req-030946d0-c5a2-4518-99fe-d640dc595bea tempest-VolumesSnapshotTestJSON-244026219 None] Connection info returned from driver {'name': 'volumes/volume-8fe875f0-142e-4db8-8a87-f78692047798', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8fe875f0-142e-4db8-8a87-f78692047798', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c45bfa47-d3ce-4dee-a809-980511fb954b'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:15:16.745851 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-ea35ce60-3e3b-4a4a-9c09-a9d5efe2af2b req-030946d0-c5a2-4518-99fe-d640dc595bea tempest-VolumesSnapshotTestJSON-244026219 None] attachment_update completed successfully.
Apr 02 21:15:16.856093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:16.857732 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:16.858504 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:16.888078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:15:16.888932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Marking volume 45b75797-22a1-4174-b01c-63b04d457e35 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:15:16.905740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Copying metadata from source volume 9c4adb7a-3061-4726-9770-b03e1018f469 to 45b75797-22a1-4174-b01c-63b04d457e35. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:436}}
Apr 02 21:15:16.960779 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce2b3b-83f0-4d86-99c9-afd3e9002ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b75797-22a1-4174-b01c-63b04d457e35', 'volume_size': 1, 'source_volid': '9c4adb7a-3061-4726-9770-b03e1018f469', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:16.974335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939e82da-f2a8-4ea7-aaf8-a1ea3ba82bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:16.992898 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Volume volume-45b75797-22a1-4174-b01c-63b04d457e35 (45b75797-22a1-4174-b01c-63b04d457e35): created successfully
Apr 02 21:15:16.998220 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (939e82da-f2a8-4ea7-aaf8-a1ea3ba82bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:17.006186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (b21e173b-dafd-4932-b937-18229807eadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:17.024725 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-6b12c852-20b0-473a-993b-3bc15cb7ff74 tempest-VolumesCloneTest-386986046 None] Created volume successfully.
Apr 02 21:15:17.923980 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:17.961647 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (bfdb1b4f-7c1b-4cce-86c9-45b16d922a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:17.974283 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e17f71-ef08-4759-b099-c68a60a0b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:17.997347 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e17f71-ef08-4759-b099-c68a60a0b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1593882335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f750709d-58dd-420b-83f9-035ae27116a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72eede125774117930b0fdb575ecb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:18Z,use_quota=True,user_id='e037b5b9cea44165ba2a586418e047f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.008613 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e47c97-f2d3-4338-8c50-886e3d312e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:18.017319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e47c97-f2d3-4338-8c50-886e3d312e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.025595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f7a557-4a02-4980-a446-9e55d508a454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:18.032929 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f7a557-4a02-4980-a446-9e55d508a454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f750709d-58dd-420b-83f9-035ae27116a0', 'volume_name': 'volume-f750709d-58dd-420b-83f9-035ae27116a0', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.055479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7048bb-52ea-4fcd-bb9f-f8bac0002362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:18.059947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7048bb-52ea-4fcd-bb9f-f8bac0002362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.066952 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c99af4a-b378-4e3f-aa66-1440d653f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:18.068239 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Volume f750709d-58dd-420b-83f9-035ae27116a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f750709d-58dd-420b-83f9-035ae27116a0', 'volume_size': 1}
Apr 02 21:15:18.068700 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] creating volume 'volume-f750709d-58dd-420b-83f9-035ae27116a0' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:15:18.069880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:18.174064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:18.174448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:18.179102 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c99af4a-b378-4e3f-aa66-1440d653f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f750709d-58dd-420b-83f9-035ae27116a0', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.189339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2903068-b833-4db1-9a80-f5025d8ef986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:18.208296 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Volume volume-f750709d-58dd-420b-83f9-035ae27116a0 (f750709d-58dd-420b-83f9-035ae27116a0): created successfully
Apr 02 21:15:18.212228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2903068-b833-4db1-9a80-f5025d8ef986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:18.217858 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (bfdb1b4f-7c1b-4cce-86c9-45b16d922a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:18.249867 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bf87b6dc-7073-4b4c-b818-88f2ec098aa2 tempest-VolumesCloneTest-386986046 None] Created volume successfully.
Apr 02 21:15:19.815113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:19.869779 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (df162691-8290-48c8-9487-4b70358e90dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:19.879988 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d1282f-9f2d-418b-bdb1-bcd1c786f44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:19.903198 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d1282f-9f2d-418b-bdb1-bcd1c786f44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1536815049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2faad4d-636c-44df-b088-a06d0fac4717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d72eede125774117930b0fdb575ecb04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f750709d-58dd-420b-83f9-035ae27116a0,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:20Z,use_quota=True,user_id='e037b5b9cea44165ba2a586418e047f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:19.910643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6133da48-afb3-43a7-8f7e-96c5a4f51af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:19.916781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6133da48-afb3-43a7-8f7e-96c5a4f51af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:19.928226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcf979e-ab1c-4be4-9d5b-96c00561f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:19.971420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcf979e-ab1c-4be4-9d5b-96c00561f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b2faad4d-636c-44df-b088-a06d0fac4717', 'volume_name': 'volume-b2faad4d-636c-44df-b088-a06d0fac4717', 'volume_size': 2, 'source_volid': 'f750709d-58dd-420b-83f9-035ae27116a0', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:19.978829 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64b0026-5073-438d-8b62-c0e7bce98879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:19.983977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64b0026-5073-438d-8b62-c0e7bce98879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:19.990157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732fceec-967f-428f-ac15-737f10e8ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:19.992098 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Volume b2faad4d-636c-44df-b088-a06d0fac4717: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b2faad4d-636c-44df-b088-a06d0fac4717', 'volume_size': 2, 'source_volid': 'f750709d-58dd-420b-83f9-035ae27116a0', 'source_volstatus': 'available'}
Apr 02 21:15:20.006935 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:20.065424 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] creating snapshot='volume-b2faad4d-636c-44df-b088-a06d0fac4717.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:15:20.969549 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] cloning 'volume-f750709d-58dd-420b-83f9-035ae27116a0@volume-b2faad4d-636c-44df-b088-a06d0fac4717.clone_snap' to 'volume-b2faad4d-636c-44df-b088-a06d0fac4717' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:15:20.972671 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e9f04704-7de1-4d67-bf90-e026285cd95e tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:21.186681 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Volume volume-f750709d-58dd-420b-83f9-035ae27116a0 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:21.188101 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:21.188588 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:21.234848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] resize volume 'volume-b2faad4d-636c-44df-b088-a06d0fac4717' from 1 to 2 {{(pid=129783) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:742}}
Apr 02 21:15:21.235785 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:21.435531 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:15:21.439563 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732fceec-967f-428f-ac15-737f10e8ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2faad4d-636c-44df-b088-a06d0fac4717', 'volume_size': 2, 'source_volid': 'f750709d-58dd-420b-83f9-035ae27116a0', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:21.448289 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f26ef8b-d7a4-473a-8459-92e7d6dad951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:21.471799 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Volume volume-b2faad4d-636c-44df-b088-a06d0fac4717 (b2faad4d-636c-44df-b088-a06d0fac4717): created successfully
Apr 02 21:15:21.476895 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f26ef8b-d7a4-473a-8459-92e7d6dad951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:21.483260 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Flow 'volume_create_manager' (df162691-8290-48c8-9487-4b70358e90dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:21.526219 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4cb7b3df-6ec9-42d6-8713-bdb3f93c4ec5 tempest-VolumesCloneTest-386986046 None] Created volume successfully.
Apr 02 21:15:22.048515 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-b2faad4d-636c-44df-b088-a06d0fac4717-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:22.145618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:22.265485 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:15:22.276916 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] deleting rbd volume volume-b2faad4d-636c-44df-b088-a06d0fac4717 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:22.377520 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e9f04704-7de1-4d67-bf90-e026285cd95e tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:15:22.719773 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:15:22.746241 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Volume volume-f750709d-58dd-420b-83f9-035ae27116a0 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:22.747987 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] deleting parent snapshot volume-b2faad4d-636c-44df-b088-a06d0fac4717.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:15:23.181421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Created reservations ['2288c34b-d690-4062-8500-d7f5de2ca276', '97f17952-46b7-4a69-8a60-37873563a18f', '06b7a67b-6bba-4102-92e6-1c834ee2af54', '6ec7b6b1-33e4-4933-b95c-bf362a0ef274'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:23.225606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b7243c90-e9ee-448c-88b4-118e900c67e6 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:23.416303 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:23.499712 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:23.573733 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:23.582504 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Deleted volume successfully.
Apr 02 21:15:23.607095 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-53b0c086-7802-4f37-9efa-73bec9adfc2c tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-b2faad4d-636c-44df-b088-a06d0fac4717-delete_volume'" released by "delete_volume" :: held 1.560s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:24.225981 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b7243c90-e9ee-448c-88b4-118e900c67e6 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:15:24.432951 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-f750709d-58dd-420b-83f9-035ae27116a0-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:24.497443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:24.630677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:15:24.631040 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Volume volume-f750709d-58dd-420b-83f9-035ae27116a0 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:24.640006 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] deleting rbd volume volume-f750709d-58dd-420b-83f9-035ae27116a0 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:25.233115 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Created reservations ['14db8025-ff55-41bb-8a0f-22fa3ce2679e', '3d64fd54-b663-4ed1-ba2f-d39e8b4e5e44', 'ff06c099-4b2d-481c-a674-5a3946b044b3', '80f4b7ac-bd37-41af-9edc-38680f3ec929'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:25.324074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:25.397738 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:25.479841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:25.483833 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Deleted volume successfully.
Apr 02 21:15:25.503364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f58f92d1-bf09-4dea-b01d-a18b300cd7fc tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-f750709d-58dd-420b-83f9-035ae27116a0-delete_volume'" released by "delete_volume" :: held 1.075s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:25.641120 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-21357e8a-62de-4b1a-8be8-028f38035f7a tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:25.793811 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-45b75797-22a1-4174-b01c-63b04d457e35-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:25.867281 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:26.009612 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:15:26.028130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] deleting rbd volume volume-45b75797-22a1-4174-b01c-63b04d457e35 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:26.323838 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-21357e8a-62de-4b1a-8be8-028f38035f7a tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:15:26.456942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:15:26.539534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] deleting parent snapshot volume-45b75797-22a1-4174-b01c-63b04d457e35.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:15:27.282923 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f49faca0-c266-4cf1-8daf-735d8495cdb7 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-d52fedd0-b6d2-4518-b6e1-0b1559e15579-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.055s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:27.284939 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f49faca0-c266-4cf1-8daf-735d8495cdb7 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:27.479696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] Created reservations ['18a32cad-7c8a-4a42-8777-ce2b164546e4', '47824033-66f6-4c3f-8e3d-254308eb0b48', 'a26f2e5a-8203-4e46-8ddf-752eabeb638f', 'cfc84a73-5441-4527-b7aa-e7128f4c467e'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:27.600023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:27.693734 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:27.768026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:27.773377 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] Deleted volume successfully.
Apr 02 21:15:27.813844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b6c797be-36d7-4471-aea3-95ee760de937 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-45b75797-22a1-4174-b01c-63b04d457e35-delete_volume'" released by "delete_volume" :: held 2.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:28.070435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-9c4adb7a-3061-4726-9770-b03e1018f469-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:28.128633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:28.255070 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:15:28.284837 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] deleting rbd volume volume-9c4adb7a-3061-4726-9770-b03e1018f469 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:28.684355 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:15:28.724656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] deleting parent snapshot volume-9c4adb7a-3061-4726-9770-b03e1018f469.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:15:29.020863 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:15:29.022048 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:29.078132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:29.137111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:29.197180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] Created reservations ['cc8eaa3a-b791-4c67-a88e-f0b17969ac65', 'a0183342-853d-4686-bf7a-87bb93a33192', '5e170015-c0a3-4804-87a2-305a87494d79', 'a4c3d630-ce51-4417-aec1-d26259bab951'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:29.308695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:29.376401 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:29.457512 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:29.462527 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] Deleted volume successfully.
Apr 02 21:15:29.476022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-410e97e3-02af-48e3-9f8f-0c370eae7104 tempest-VolumesCloneTest-386986046 None] Lock "b'cinder-9c4adb7a-3061-4726-9770-b03e1018f469-delete_volume'" released by "delete_volume" :: held 1.406s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:33.576166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:15:33.612261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Flow 'volume_create_manager' (17c4e153-a2e4-4247-9c31-3d0313a2fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:33.619800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f211c1af-a4ea-47b8-a62c-7a4ce5e986ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.658537 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f211c1af-a4ea-47b8-a62c-7a4ce5e986ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-888977675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c0ceaab-e46d-46a3-a766-d6ba6e126182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f523714f06e1427cb2532d3bf68366b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:15:34Z,use_quota=True,user_id='9afbc73cfa6844d48f99cb6747046e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.666581 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55668436-97d2-4437-9daf-b56ae1e2a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.671152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55668436-97d2-4437-9daf-b56ae1e2a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.677754 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dd7e12-b1b7-4628-83bb-3634c28aa08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.682826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dd7e12-b1b7-4628-83bb-3634c28aa08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0ceaab-e46d-46a3-a766-d6ba6e126182', 'volume_name': 'volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.688313 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dee663-78ed-4752-910f-915bb93ead64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.692973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dee663-78ed-4752-910f-915bb93ead64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.697956 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47e296d-b5f9-431d-acee-e8c58873a9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.699103 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Volume 1c0ceaab-e46d-46a3-a766-d6ba6e126182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182', 'volume_size': 1}
Apr 02 21:15:33.699501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] creating volume 'volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:15:33.700563 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:33.777078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:15:33.777470 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:15:33.786660 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47e296d-b5f9-431d-acee-e8c58873a9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.794337 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdff59e9-a88e-4f92-b1aa-8b2b58e6e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:15:33.806354 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Volume volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182 (1c0ceaab-e46d-46a3-a766-d6ba6e126182): created successfully
Apr 02 21:15:33.823021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdff59e9-a88e-4f92-b1aa-8b2b58e6e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:15:33.838427 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Flow 'volume_create_manager' (17c4e153-a2e4-4247-9c31-3d0313a2fb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:15:33.868519 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2a463e99-4cd4-4d58-a9d6-136a2a6c5280 tempest-VolumesSnapshotListTestJSON-2075673842 None] Created volume successfully.
Apr 02 21:15:34.841421 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0d7720ba-6941-4b66-afa8-0674a7fe1b0f tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:35.591519 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0d7720ba-6941-4b66-afa8-0674a7fe1b0f tempest-VolumesSnapshotListTestJSON-2075673842 None] Create snapshot completed successfully
Apr 02 21:15:36.099420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fc40a4c2-6351-4026-ada9-78e1f8462a95 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:36.602319 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fc40a4c2-6351-4026-ada9-78e1f8462a95 tempest-VolumesSnapshotListTestJSON-2075673842 None] Create snapshot completed successfully
Apr 02 21:15:37.522534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-5b2a034a-6392-4c76-9c96-8292482a7196 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:38.694026 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-5b2a034a-6392-4c76-9c96-8292482a7196 tempest-VolumesSnapshotListTestJSON-2075673842 None] Create snapshot completed successfully
Apr 02 21:15:40.724823 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8e31224b-c1c8-424e-b454-33573070766a tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-9c20da36-cf72-4f4e-979f-d647fbcbe645-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:40.726208 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8e31224b-c1c8-424e-b454-33573070766a tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:41.817765 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-8e31224b-c1c8-424e-b454-33573070766a tempest-VolumesSnapshotListTestJSON-2075673842 None] Created reservations ['c090504c-d8cb-470d-8edc-1586cab70fe5', 'dc7b7eb6-5a4e-4fe0-8f72-52a4f8c9fec4', '9bdbf2be-a7d5-4ed5-91e4-a961cb513162', '9674abc6-fd3e-4d51-9549-fd3804eee1e4'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:41.896075 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8e31224b-c1c8-424e-b454-33573070766a tempest-VolumesSnapshotListTestJSON-2075673842 None] Delete snapshot completed successfully.
Apr 02 21:15:41.901228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8e31224b-c1c8-424e-b454-33573070766a tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-9c20da36-cf72-4f4e-979f-d647fbcbe645-delete_snapshot'" released by "delete_snapshot" :: held 1.177s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:42.926772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-56462068-a2ed-4631-ab09-bcb3287acfdd tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-3d72e98d-4928-4c45-8dd1-e7c885478bf1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:42.935883 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-56462068-a2ed-4631-ab09-bcb3287acfdd tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:43.764436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-56462068-a2ed-4631-ab09-bcb3287acfdd tempest-VolumesSnapshotListTestJSON-2075673842 None] Created reservations ['aa365241-0841-4a2a-8166-31d30893993a', '0d61dd8b-29d9-46c7-8611-56879a6c334a', 'ad31b9eb-ebf6-44b9-aca0-3b94644daa4a', '96ef6e0e-b599-4458-9a5a-6d1ec5198fc7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:43.870937 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-56462068-a2ed-4631-ab09-bcb3287acfdd tempest-VolumesSnapshotListTestJSON-2075673842 None] Delete snapshot completed successfully.
Apr 02 21:15:43.879867 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-56462068-a2ed-4631-ab09-bcb3287acfdd tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-3d72e98d-4928-4c45-8dd1-e7c885478bf1-delete_snapshot'" released by "delete_snapshot" :: held 0.951s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:44.187700 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e8ce5d03-d939-4dde-9925-87b69062ad0e tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-055ffc4c-7d39-414c-9014-58797cda8e87-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.046s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:44.196836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e8ce5d03-d939-4dde-9925-87b69062ad0e tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:45.181999 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e8ce5d03-d939-4dde-9925-87b69062ad0e tempest-VolumesSnapshotListTestJSON-2075673842 None] Created reservations ['0420368e-eb0b-4154-854d-90f9a24c697a', '526549b6-f5fe-4436-8059-3fbea20bcc03', 'ee63062c-095e-427c-a496-e0cb7c484cbf', 'db182430-a448-4569-bdc6-22b725d6a6a7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:45.305092 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e8ce5d03-d939-4dde-9925-87b69062ad0e tempest-VolumesSnapshotListTestJSON-2075673842 None] Delete snapshot completed successfully.
Apr 02 21:15:45.310189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e8ce5d03-d939-4dde-9925-87b69062ad0e tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-055ffc4c-7d39-414c-9014-58797cda8e87-delete_snapshot'" released by "delete_snapshot" :: held 1.123s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:45.460242 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-1c0ceaab-e46d-46a3-a766-d6ba6e126182-delete_volume'" acquired by "delete_volume" :: waited 0.059s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:45.542283 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:45.633642 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:15:45.634066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Volume volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:15:45.647492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] deleting rbd volume volume-1c0ceaab-e46d-46a3-a766-d6ba6e126182 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:15:46.126501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Created reservations ['b855e9f5-2bf7-44bb-9263-cb2334eeb188', '5ea48dc4-bc2b-4812-9a41-2ffbd4ed813a', 'ce65edbe-4b2e-40be-8642-5cb0f20c2eb2', 'd2a97e9c-36f7-4dd7-92d1-3ea9981f488c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:46.248655 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:46.304739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:15:46.399346 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:15:46.404111 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Deleted volume successfully.
Apr 02 21:15:46.424266 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-076248ec-1a1a-466f-b0af-7352cde2b1b3 tempest-VolumesSnapshotListTestJSON-2075673842 None] Lock "b'cinder-1c0ceaab-e46d-46a3-a766-d6ba6e126182-delete_volume'" released by "delete_volume" :: held 0.964s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:57.618374 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f49faca0-c266-4cf1-8daf-735d8495cdb7 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['19a15fb3-6f0d-4604-991e-51218a34e8f3', '5836df07-574f-4555-a8e4-05c20fe7c662', '92944514-66bd-4cf6-a810-12062b0169c8', 'c5524880-f387-402e-83fa-53014ab0d390'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:15:57.681428 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f49faca0-c266-4cf1-8daf-735d8495cdb7 tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:15:57.686448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f49faca0-c266-4cf1-8daf-735d8495cdb7 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-d52fedd0-b6d2-4518-b6e1-0b1559e15579-delete_snapshot'" released by "delete_snapshot" :: held 30.404s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:15:58.667691 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-fa8bfa4f-edd2-4a6b-9430-8ca9d9b7c132 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-ea4479b4-ba7d-4c53-a858-77e5c5ee1d98-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.021s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:15:58.689261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fa8bfa4f-edd2-4a6b-9430-8ca9d9b7c132 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:16:29.024846 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:16:29.026850 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:16:29.112123 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:16:29.173414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:16:29.197705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-fa8bfa4f-edd2-4a6b-9430-8ca9d9b7c132 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['64bdaf91-eb2e-4314-9be4-18a348b3193e', '7ca1ee9d-6f9b-4630-9496-f17b159d498a', '07ced5c1-bcb1-43a5-aaf2-ada456a07a62', 'f15249ba-bbd5-4c35-9b98-9925cc379471'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:16:29.290510 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fa8bfa4f-edd2-4a6b-9430-8ca9d9b7c132 tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:16:29.299623 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-fa8bfa4f-edd2-4a6b-9430-8ca9d9b7c132 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-ea4479b4-ba7d-4c53-a858-77e5c5ee1d98-delete_snapshot'" released by "delete_snapshot" :: held 30.629s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:16:29.417292 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7df0d5f7-cf6c-48f6-90c5-ad8212fc94cf tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-15a73af3-8acd-4e48-bf6f-636b17da7ea0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:16:29.419535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7df0d5f7-cf6c-48f6-90c5-ad8212fc94cf tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:16:59.726864 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7df0d5f7-cf6c-48f6-90c5-ad8212fc94cf tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['59faadbe-52ec-4574-92a7-fe8a43d8638a', 'b4f01544-b13f-4339-b6c6-cd31c688282b', '536ba27c-9b67-4348-8e82-086d1d840650', '496353ab-7cf2-45fe-9216-eaebd1c4004a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:16:59.783220 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7df0d5f7-cf6c-48f6-90c5-ad8212fc94cf tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:16:59.789917 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7df0d5f7-cf6c-48f6-90c5-ad8212fc94cf tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-15a73af3-8acd-4e48-bf6f-636b17da7ea0-delete_snapshot'" released by "delete_snapshot" :: held 30.373s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:00.802698 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-2f0779f0-b014-4721-879b-84a4e10e0166 req-fa81b876-4d2e-4bf7-806b-d468f8d896ef tempest-VolumesSnapshotTestJSON-244026219 None] Terminate volume connection completed successfully.
Apr 02 21:17:00.803255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-2f0779f0-b014-4721-879b-84a4e10e0166 req-fa81b876-4d2e-4bf7-806b-d468f8d896ef tempest-VolumesSnapshotTestJSON-244026219 None] Deleting attachment c45bfa47-d3ce-4dee-a809-980511fb954b. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:17:06.288201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0159284f-8bc2-4d27-9de8-1b03836ad5e3 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:06.623805 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0159284f-8bc2-4d27-9de8-1b03836ad5e3 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:17:07.547117 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f34158da-c1b8-44a7-b5b1-7eabb4057bb4 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-61b3dd6f-5e4d-4422-8e30-0e75c02361f3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:07.550638 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f34158da-c1b8-44a7-b5b1-7eabb4057bb4 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:08.638016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f34158da-c1b8-44a7-b5b1-7eabb4057bb4 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['0eb231da-e790-4fe1-af93-81f4f8c9f383', '9bf06943-72f8-42bd-832e-708ac63986e0', '4910db7b-8e03-43d2-9494-793a58c38217', '557370f2-6756-419a-b437-facd1167760f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:17:08.682825 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f34158da-c1b8-44a7-b5b1-7eabb4057bb4 tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:17:08.688690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f34158da-c1b8-44a7-b5b1-7eabb4057bb4 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-61b3dd6f-5e4d-4422-8e30-0e75c02361f3-delete_snapshot'" released by "delete_snapshot" :: held 1.142s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:10.010419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-28ad9905-1802-46b1-bc2a-e00c5d4b81e3 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:11.322849 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-28ad9905-1802-46b1-bc2a-e00c5d4b81e3 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:17:15.738812 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-dc42ed6b-740a-4644-aad4-5f21bb2dcae2 tempest-GroupsV320Test-1110131489 None] Group tempest-GroupsV320Test-Group-2046485915: creating
Apr 02 21:17:15.782105 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-dc42ed6b-740a-4644-aad4-5f21bb2dcae2 tempest-GroupsV320Test-1110131489 None] Group tempest-GroupsV320Test-Group-2046485915: created successfully
Apr 02 21:17:15.792701 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-dc42ed6b-740a-4644-aad4-5f21bb2dcae2 tempest-GroupsV320Test-1110131489 None] Create group completed successfully.
Apr 02 21:17:17.587226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-012202d8-bb00-466c-bbcc-f724915c61cf tempest-GroupsV320Test-1110131489 None] Created reservations ['a702356e-0654-452c-820e-d9f6255dab90'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:17:17.653180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-012202d8-bb00-466c-bbcc-f724915c61cf tempest-GroupsV320Test-1110131489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:17.714341 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-012202d8-bb00-466c-bbcc-f724915c61cf tempest-GroupsV320Test-1110131489 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:17.770009 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-012202d8-bb00-466c-bbcc-f724915c61cf tempest-GroupsV320Test-1110131489 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:17:17.776477 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-012202d8-bb00-466c-bbcc-f724915c61cf tempest-GroupsV320Test-1110131489 None] Delete group completed successfully.
Apr 02 21:17:28.382195 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-32192b0c-f5f4-4ef3-b985-16aebf309e04 req-afe323cd-7f37-4bdb-bb02-a54df731c365 tempest-VolumesSnapshotTestJSON-244026219 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:17:29.021672 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:17:29.023083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:29.104808 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:29.203830 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:17:29.648146 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-32192b0c-f5f4-4ef3-b985-16aebf309e04 req-afe323cd-7f37-4bdb-bb02-a54df731c365 tempest-VolumesSnapshotTestJSON-244026219 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.265s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:17:29.649773 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-32192b0c-f5f4-4ef3-b985-16aebf309e04 req-afe323cd-7f37-4bdb-bb02-a54df731c365 tempest-VolumesSnapshotTestJSON-244026219 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c87f93d6-de80-42a3-9d17-3629759f6c8b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'c87f93d6-de80-42a3-9d17-3629759f6c8b', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:17:29.707641 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-32192b0c-f5f4-4ef3-b985-16aebf309e04 req-afe323cd-7f37-4bdb-bb02-a54df731c365 tempest-VolumesSnapshotTestJSON-244026219 None] Connection info returned from driver {'name': 'volumes/volume-c87f93d6-de80-42a3-9d17-3629759f6c8b', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c87f93d6-de80-42a3-9d17-3629759f6c8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2f15a059-fe81-4cd1-b60b-7dbed3763589'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:17:29.831094 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-32192b0c-f5f4-4ef3-b985-16aebf309e04 req-afe323cd-7f37-4bdb-bb02-a54df731c365 tempest-VolumesSnapshotTestJSON-244026219 None] attachment_update completed successfully.
Apr 02 21:17:31.872795 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-de61bbbd-eb18-4043-8886-c6e9fc3e6cdc tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:32.581471 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-de61bbbd-eb18-4043-8886-c6e9fc3e6cdc tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:17:33.177274 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e50920f7-ec95-4b97-9a8c-b7d62ecc6271 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:33.616053 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e50920f7-ec95-4b97-9a8c-b7d62ecc6271 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:17:34.272678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7fbf8602-3d08-41a5-ae11-2afc6b524ded tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-de13c935-80b0-4660-8028-be1369657488-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:34.274398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7fbf8602-3d08-41a5-ae11-2afc6b524ded tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:46.408847 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:17:46.443663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (6f6deb88-ac61-4d8a-8453-3804f75f75fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:46.460844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf942fe-4985-4655-b0bd-363f177bed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.498358 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf942fe-4985-4655-b0bd-363f177bed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2136818600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a5a79177-3536-4876-a375-317b347d85f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:17:46Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.509572 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f156f-0ffd-4d0c-be93-9a2c09544971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.515949 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f156f-0ffd-4d0c-be93-9a2c09544971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.523733 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9f8c1b-e151-4332-a917-39bc9c20b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.528592 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9f8c1b-e151-4332-a917-39bc9c20b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a79177-3536-4876-a375-317b347d85f3', 'volume_name': 'volume-a5a79177-3536-4876-a375-317b347d85f3', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.534267 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc0669e-ffe2-474c-9b33-47c28badd8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.538718 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc0669e-ffe2-474c-9b33-47c28badd8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.544408 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c0d4a0-f20d-42bf-88c2-7b9ac4bdd33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.545849 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Volume a5a79177-3536-4876-a375-317b347d85f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a79177-3536-4876-a375-317b347d85f3', 'volume_size': 1}
Apr 02 21:17:46.546443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] creating volume 'volume-a5a79177-3536-4876-a375-317b347d85f3' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:17:46.547863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:46.660531 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:17:46.661177 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:17:46.665794 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c0d4a0-f20d-42bf-88c2-7b9ac4bdd33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a79177-3536-4876-a375-317b347d85f3', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.672420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4fffee-20ed-4736-af0b-25713fd67e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:46.688786 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Volume volume-a5a79177-3536-4876-a375-317b347d85f3 (a5a79177-3536-4876-a375-317b347d85f3): created successfully
Apr 02 21:17:46.697983 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4fffee-20ed-4736-af0b-25713fd67e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:46.703888 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (6f6deb88-ac61-4d8a-8453-3804f75f75fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:46.715767 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7f960360-ef4d-4ea6-bc28-0b9fd49ee5a6 tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:17:47.437852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c7ff433e-8b27-487a-afe5-c86ac6113fc6 tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3'" acquired by "attach_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:47.499900 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c7ff433e-8b27-487a-afe5-c86ac6113fc6 tempest-VolumesActionsTest-357684092 None] Attaching volume a5a79177-3536-4876-a375-317b347d85f3 to instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50 at mountpoint /dev/sdb on host None.
Apr 02 21:17:47.531550 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c7ff433e-8b27-487a-afe5-c86ac6113fc6 tempest-VolumesActionsTest-357684092 None] Attach volume completed successfully.
Apr 02 21:17:47.539601 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c7ff433e-8b27-487a-afe5-c86ac6113fc6 tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3'" released by "attach_volume" :: held 0.102s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:48.223105 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ce1c6201-6793-4ef2-88e6-efc01476b5d8 tempest-VolumesActionsTest-1183663440 None] Terminate volume connection completed successfully.
Apr 02 21:17:48.263153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ce1c6201-6793-4ef2-88e6-efc01476b5d8 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-detach_volume'" acquired by "detach_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:48.286797 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ce1c6201-6793-4ef2-88e6-efc01476b5d8 tempest-VolumesActionsTest-1183663440 None] Detaching volume a5a79177-3536-4876-a375-317b347d85f3 from instance 2e0def33-d08e-43ec-98f8-9ada1c9cdb50.
Apr 02 21:17:48.342964 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ce1c6201-6793-4ef2-88e6-efc01476b5d8 tempest-VolumesActionsTest-1183663440 None] Detach volume completed successfully.
Apr 02 21:17:48.353994 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-ce1c6201-6793-4ef2-88e6-efc01476b5d8 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-detach_volume'" released by "detach_volume" :: held 0.091s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:48.648909 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bd59a227-8ef7-4105-b706-cc7702f78dcc tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-detach_volume'" acquired by "detach_volume" :: waited 0.020s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:48.649643 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bd59a227-8ef7-4105-b706-cc7702f78dcc tempest-VolumesActionsTest-357684092 None] Volume detach called, but volume not attached.
Apr 02 21:17:48.673428 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bd59a227-8ef7-4105-b706-cc7702f78dcc tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-detach_volume'" released by "detach_volume" :: held 0.025s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:53.178096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:17:53.212875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (e63a0fce-b91e-44fd-80f4-22dacfef29c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:53.222175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fe5a92-ad4d-4177-b755-06db56d947d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.242581 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fe5a92-ad4d-4177-b755-06db56d947d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1186599397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb913a06-670c-44e7-b5e8-59a1d076b909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:17:53Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.249998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b610a0aa-2c75-4725-8c16-90b7a843c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.254448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b610a0aa-2c75-4725-8c16-90b7a843c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.260359 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c96e9-54db-4d72-905a-6e0feb6f057f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.265338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c96e9-54db-4d72-905a-6e0feb6f057f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb913a06-670c-44e7-b5e8-59a1d076b909', 'volume_name': 'volume-cb913a06-670c-44e7-b5e8-59a1d076b909', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.275937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4d6ea0-6183-492f-88d4-6cedf0ccb5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.293959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4d6ea0-6183-492f-88d4-6cedf0ccb5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.307779 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101649ba-6b53-47bf-8593-0b21af4506ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.311257 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Volume cb913a06-670c-44e7-b5e8-59a1d076b909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb913a06-670c-44e7-b5e8-59a1d076b909', 'volume_size': 1}
Apr 02 21:17:53.312633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] creating volume 'volume-cb913a06-670c-44e7-b5e8-59a1d076b909' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:17:53.313371 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:53.475688 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:17:53.475907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:17:53.485693 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101649ba-6b53-47bf-8593-0b21af4506ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb913a06-670c-44e7-b5e8-59a1d076b909', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.490434 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dc8272-ae48-44a3-aa36-b84ba1be3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:53.500711 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Volume volume-cb913a06-670c-44e7-b5e8-59a1d076b909 (cb913a06-670c-44e7-b5e8-59a1d076b909): created successfully
Apr 02 21:17:53.505362 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dc8272-ae48-44a3-aa36-b84ba1be3efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:53.511965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (e63a0fce-b91e-44fd-80f4-22dacfef29c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:53.535690 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e996327b-7635-4e22-b558-01a7b0d5f371 tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:17:54.308241 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-cb913a06-670c-44e7-b5e8-59a1d076b909-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:54.386263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:54.523316 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:17:54.523943 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Volume volume-cb913a06-670c-44e7-b5e8-59a1d076b909 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:17:54.538128 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] deleting rbd volume volume-cb913a06-670c-44e7-b5e8-59a1d076b909 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:17:55.084027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Created reservations ['577d3e62-8831-4b84-89e1-2ffe31dadc9e', '713ee408-6f56-4ee2-86c5-ace6bcee7be8', '300272c6-229f-4163-9ed8-7a94a1224a4d', 'afbc5a74-ea0d-4c84-9785-020f73862905'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:17:55.170833 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:55.233709 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:55.318064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:17:55.322828 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Deleted volume successfully.
Apr 02 21:17:55.336980 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-161908d0-6994-412e-a86d-74f838c658b0 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-cb913a06-670c-44e7-b5e8-59a1d076b909-delete_volume'" released by "delete_volume" :: held 1.029s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:55.980027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:17:55.999687 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (1b5fd523-b530-4070-8bd2-5eff10cf3418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:56.013650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724e7046-8a84-4d7f-a29c-523e1a30b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.063448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724e7046-8a84-4d7f-a29c-523e1a30b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-168465327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=032d775e-e3b3-4c0d-ad05-a5b44a4a64a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:17:56Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.074327 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5ae60f-2728-4178-a957-4c944e27da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.091624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a5ae60f-2728-4178-a957-4c944e27da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.097077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1b1187-3f84-4102-853b-c63f60f9304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.101841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c1b1187-3f84-4102-853b-c63f60f9304e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032d775e-e3b3-4c0d-ad05-a5b44a4a64a2', 'volume_name': 'volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.107430 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5e8faf-52e4-44ce-863c-4ecd26c76bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.111857 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5e8faf-52e4-44ce-863c-4ecd26c76bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.116777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047a58ce-1e6e-4253-894c-f65d8594cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.117949 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Volume 032d775e-e3b3-4c0d-ad05-a5b44a4a64a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2', 'volume_size': 1}
Apr 02 21:17:56.118410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] creating volume 'volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:17:56.119264 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:56.216448 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:17:56.216859 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:17:56.220638 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047a58ce-1e6e-4253-894c-f65d8594cc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.225524 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350aea2a-1e70-4a8a-9b67-2aebf7f03285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:56.235879 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Volume volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2 (032d775e-e3b3-4c0d-ad05-a5b44a4a64a2): created successfully
Apr 02 21:17:56.242076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350aea2a-1e70-4a8a-9b67-2aebf7f03285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:56.249717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (1b5fd523-b530-4070-8bd2-5eff10cf3418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:56.275354 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4648f4bc-d670-481d-ad89-df34f62761ce tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:17:57.059422 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:57.126420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:57.184625 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:17:57.185141 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Volume volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:17:57.198985 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] deleting rbd volume volume-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:17:57.506615 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Created reservations ['a83d23c5-0bb3-4885-9752-5c10ef07415c', 'ed3f0c73-1efd-4bc9-bbe2-2cf2382f2a99', '1285b715-95bc-419a-a4c7-041e8f5f2565', 'c936be41-bfae-44a5-9c85-4276a7e45054'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:17:57.563123 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:57.617014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:57.658393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:17:57.669559 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Deleted volume successfully.
Apr 02 21:17:57.687624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-88ac69c5-9b18-4f08-8ab2-5ea1b2f47250 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-032d775e-e3b3-4c0d-ad05-a5b44a4a64a2-delete_volume'" released by "delete_volume" :: held 0.628s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:17:58.556211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:17:58.576805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (aa11a9fc-3d5a-41fd-a2e8-ab384f686a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:58.583722 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10db4b1-8699-4a07-a68d-8d3453515aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.604770 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10db4b1-8699-4a07-a68d-8d3453515aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1529897521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7757de6d-e522-4ecf-8ccd-e870b6ca04f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:17:59Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.611589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214b01f7-fd64-4360-be2c-259450edffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.615894 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214b01f7-fd64-4360-be2c-259450edffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.621634 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cd9d96-c3d0-4e9a-8f23-2ee2de966b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.625932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cd9d96-c3d0-4e9a-8f23-2ee2de966b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7757de6d-e522-4ecf-8ccd-e870b6ca04f8', 'volume_name': 'volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.630959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fe0e4-8167-4302-b896-4fd2d83963ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.634989 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fe0e4-8167-4302-b896-4fd2d83963ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.644735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f936a4-67c6-491e-8d42-80a5b48eee1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.646500 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Volume 7757de6d-e522-4ecf-8ccd-e870b6ca04f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8', 'volume_size': 1}
Apr 02 21:17:58.646841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] creating volume 'volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:17:58.647621 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:58.712310 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:17:58.712982 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:17:58.717674 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f936a4-67c6-491e-8d42-80a5b48eee1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.722569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb7aa5-7ab9-4842-adeb-729e42680cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:17:58.735128 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Volume volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8 (7757de6d-e522-4ecf-8ccd-e870b6ca04f8): created successfully
Apr 02 21:17:58.738141 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb7aa5-7ab9-4842-adeb-729e42680cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:17:58.744043 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (aa11a9fc-3d5a-41fd-a2e8-ab384f686a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:17:58.753320 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4d53eaf4-e47d-4cf7-b3f5-3e5529171f41 tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:17:59.816489 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-7757de6d-e522-4ecf-8ccd-e870b6ca04f8-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:17:59.868228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:17:59.969312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:17:59.969837 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Volume volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:17:59.977187 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] deleting rbd volume volume-7757de6d-e522-4ecf-8ccd-e870b6ca04f8 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:00.388756 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Created reservations ['e804d226-e0aa-412e-8126-787ce052f86a', '27dd1381-d0ce-49bd-8b5a-ef6fd447c876', '8c26d60d-9b90-4135-bb4a-5a65f9d3bd0e', 'd35a2d12-9a6f-4cdd-b0ce-09e4ff32feda'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:00.445291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:00.487394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:00.537435 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:00.555924 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Deleted volume successfully.
Apr 02 21:18:00.571516 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0c119618-d93c-4e83-9ebd-04c3756aa44f tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-7757de6d-e522-4ecf-8ccd-e870b6ca04f8-delete_volume'" released by "delete_volume" :: held 0.755s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:01.309550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:01.333353 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (2922c80c-0af9-40ae-83c5-63ab57e2ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:01.344021 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24694118-c318-4f6f-aca4-9a51c027c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.364587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24694118-c318-4f6f-aca4-9a51c027c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-282257936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=525ea7c0-b182-4749-8e80-58abcec9a4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:01Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.372001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccafe30f-0516-40a3-909d-6ec5e502b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.377607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccafe30f-0516-40a3-909d-6ec5e502b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.382934 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7439d52-6833-4de9-8292-336a8fadee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.387424 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7439d52-6833-4de9-8292-336a8fadee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525ea7c0-b182-4749-8e80-58abcec9a4fb', 'volume_name': 'volume-525ea7c0-b182-4749-8e80-58abcec9a4fb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.393646 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d74b5b-4344-46d1-a023-8e90c320442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.398111 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d74b5b-4344-46d1-a023-8e90c320442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.403179 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9caec0-750a-4128-9498-105ea4ca799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.405045 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Volume 525ea7c0-b182-4749-8e80-58abcec9a4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525ea7c0-b182-4749-8e80-58abcec9a4fb', 'volume_size': 1}
Apr 02 21:18:01.405449 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] creating volume 'volume-525ea7c0-b182-4749-8e80-58abcec9a4fb' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:01.406248 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:01.491587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:01.491997 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:01.498673 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9caec0-750a-4128-9498-105ea4ca799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525ea7c0-b182-4749-8e80-58abcec9a4fb', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.503630 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd64d3-7478-4cd0-93c2-9f385a69284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:01.514750 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Volume volume-525ea7c0-b182-4749-8e80-58abcec9a4fb (525ea7c0-b182-4749-8e80-58abcec9a4fb): created successfully
Apr 02 21:18:01.519147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd64d3-7478-4cd0-93c2-9f385a69284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:01.525159 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (2922c80c-0af9-40ae-83c5-63ab57e2ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:01.533561 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c9d60088-49b7-44a0-9b03-e30673920a85 tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:18:02.620148 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-525ea7c0-b182-4749-8e80-58abcec9a4fb-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:02.650422 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:02.729214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:02.729921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Volume volume-525ea7c0-b182-4749-8e80-58abcec9a4fb is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:02.737706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] deleting rbd volume volume-525ea7c0-b182-4749-8e80-58abcec9a4fb {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:03.165394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Created reservations ['43e4e732-f938-4ff4-b745-d047b19d63e8', '31b2c1dc-3746-4a0b-a4ad-54495fc3478a', 'f5f2efcb-693d-4249-9129-2fe16b7248a2', '0f1a56ba-a6cf-4e4a-8421-041690cbb459'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:03.255847 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:03.332560 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:03.421085 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:03.427383 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Deleted volume successfully.
Apr 02 21:18:03.460402 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e96a8166-5c68-4a47-9911-e9a6003e9b32 tempest-VolumesActionsTest-1183663440 None] Lock "b'cinder-525ea7c0-b182-4749-8e80-58abcec9a4fb-delete_volume'" released by "delete_volume" :: held 0.840s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:04.128776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:04.150731 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (3521d5ff-8bca-48c6-ba65-5a093f363556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:04.157609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2238a-0cda-4675-81bb-5a0989f26012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.181149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2238a-0cda-4675-81bb-5a0989f26012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-341937942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2cf1b22-8900-4a38-bb84-497ec0473a83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4fc60def4456798130d3fcadb83da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:04Z,use_quota=True,user_id='96cae46738834216b9d7cb13be80452e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.187845 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439c2357-15f1-43f5-8f20-26ebba185b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.194188 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (439c2357-15f1-43f5-8f20-26ebba185b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.200823 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d7f33c-8ee7-4af5-9a1d-adf4e6c41f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.207433 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d7f33c-8ee7-4af5-9a1d-adf4e6c41f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2cf1b22-8900-4a38-bb84-497ec0473a83', 'volume_name': 'volume-b2cf1b22-8900-4a38-bb84-497ec0473a83', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.214145 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759e210b-a5c6-4d06-a952-05c0b8e3de47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.220973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759e210b-a5c6-4d06-a952-05c0b8e3de47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.226266 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee773314-d050-44b2-92e5-ab4c90d42c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.227681 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Volume b2cf1b22-8900-4a38-bb84-497ec0473a83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2cf1b22-8900-4a38-bb84-497ec0473a83', 'volume_size': 1}
Apr 02 21:18:04.228159 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] creating volume 'volume-b2cf1b22-8900-4a38-bb84-497ec0473a83' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:04.229070 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:04.311225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:04.311522 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:04.317462 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee773314-d050-44b2-92e5-ab4c90d42c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cf1b22-8900-4a38-bb84-497ec0473a83', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.322960 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc1c1e3-bfc1-4803-a10e-e530a9fcf262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:04.341923 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Volume volume-b2cf1b22-8900-4a38-bb84-497ec0473a83 (b2cf1b22-8900-4a38-bb84-497ec0473a83): created successfully
Apr 02 21:18:04.348004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc1c1e3-bfc1-4803-a10e-e530a9fcf262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:04.354123 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Flow 'volume_create_manager' (3521d5ff-8bca-48c6-ba65-5a093f363556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:04.363952 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-17d60577-24d2-4c2c-a02c-214f77c8760d tempest-VolumesActionsTest-357684092 None] Created volume successfully.
Apr 02 21:18:04.472239 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7fbf8602-3d08-41a5-ae11-2afc6b524ded tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['9427e8ad-4340-4462-9642-b77e6c51ebb7', 'e32fdd9e-d471-44ca-8943-fc7f84f4b417', '671d5931-ecdf-4e83-b27a-6d1d910a047d', '31286703-ecc9-4c14-97aa-13f39a98eca5'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:04.516173 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7fbf8602-3d08-41a5-ae11-2afc6b524ded tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:18:04.522066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7fbf8602-3d08-41a5-ae11-2afc6b524ded tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-de13c935-80b0-4660-8028-be1369657488-delete_snapshot'" released by "delete_snapshot" :: held 30.250s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:05.621118 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-74519e3f-5a72-42de-b981-34298e27b3fd tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-c39b2b1a-1b0b-43e5-8618-80834d27cc4b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:05.623211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-74519e3f-5a72-42de-b981-34298e27b3fd tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:05.800492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-b2cf1b22-8900-4a38-bb84-497ec0473a83-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:05.845303 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:05.916130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:05.916921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Volume volume-b2cf1b22-8900-4a38-bb84-497ec0473a83 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:05.926797 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] deleting rbd volume volume-b2cf1b22-8900-4a38-bb84-497ec0473a83 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:06.204973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Created reservations ['3b591164-f95f-4a63-bf81-a61e2204a4eb', 'fc916546-1eb9-4ca8-a3b6-b035b82e816d', '4a449a00-b090-467f-8723-747f7fc1658c', '4b63a076-5782-4059-af87-d773f2365a41'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:06.266930 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:06.327419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:06.394460 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:06.401988 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Deleted volume successfully.
Apr 02 21:18:06.420032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a08fe6f5-0b77-4845-b24e-9fcd2118d5eb tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-b2cf1b22-8900-4a38-bb84-497ec0473a83-delete_volume'" released by "delete_volume" :: held 0.620s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:07.185119 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:07.260006 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:07.348074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:07.348739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Volume volume-a5a79177-3536-4876-a375-317b347d85f3 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:07.357138 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] deleting rbd volume volume-a5a79177-3536-4876-a375-317b347d85f3 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:07.770070 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Created reservations ['b9284b6e-1611-496d-8dd3-0ff384c75276', 'e5b52464-b321-4b6d-b17d-ab9b74c84555', '7c026edd-e202-4bc9-8a94-9ca631976f03', '2955d5f2-fe52-4584-b4d7-735c7d4f5e52'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:07.829385 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:07.891806 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:07.954182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:07.966839 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Deleted volume successfully.
Apr 02 21:18:07.981536 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-9d14ed2c-2128-4c35-879b-452674878bcc tempest-VolumesActionsTest-357684092 None] Lock "b'cinder-a5a79177-3536-4876-a375-317b347d85f3-delete_volume'" released by "delete_volume" :: held 0.796s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:12.788414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:12.873317 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (5ef5694b-6cb3-4503-b906-5b13a9015025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:12.886915 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c90c4f-0bbc-4d81-9e28-f696f4f4dfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:12.907526 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c90c4f-0bbc-4d81-9e28-f696f4f4dfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-492743532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=81cb38df-1e06-4b52-97e1-4547ef5413f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:13Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:12.929945 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb80564-78c8-441d-afb1-168795e7104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:12.935185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb80564-78c8-441d-afb1-168795e7104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:12.942258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bc4f39-8034-46ff-be6d-3f0f6accc980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:12.946539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bc4f39-8034-46ff-be6d-3f0f6accc980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81cb38df-1e06-4b52-97e1-4547ef5413f9', 'volume_name': 'volume-81cb38df-1e06-4b52-97e1-4547ef5413f9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:12.955538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ba9b48-52dc-42cb-b54a-2c881203a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:12.959699 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ba9b48-52dc-42cb-b54a-2c881203a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:12.964696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a3dc5f-dc4f-42ce-a571-b7a864eea440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:12.966348 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Volume 81cb38df-1e06-4b52-97e1-4547ef5413f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81cb38df-1e06-4b52-97e1-4547ef5413f9', 'volume_size': 1}
Apr 02 21:18:12.966748 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] creating volume 'volume-81cb38df-1e06-4b52-97e1-4547ef5413f9' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:12.967878 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:13.093011 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:13.093590 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:13.099032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a3dc5f-dc4f-42ce-a571-b7a864eea440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81cb38df-1e06-4b52-97e1-4547ef5413f9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:13.106266 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82bde6-6fec-458f-9e08-012e98fa2bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:13.120929 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Volume volume-81cb38df-1e06-4b52-97e1-4547ef5413f9 (81cb38df-1e06-4b52-97e1-4547ef5413f9): created successfully
Apr 02 21:18:13.134643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db82bde6-6fec-458f-9e08-012e98fa2bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:13.143026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (5ef5694b-6cb3-4503-b906-5b13a9015025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:13.161767 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-19108e13-3a9a-4261-9374-2ce0b7b69554 tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:14.533296 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:14.557973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (242d0149-d901-4764-a9d1-1218604abf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:14.568575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a88c45-86fe-46b7-a127-00e1e87adeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.594425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a88c45-86fe-46b7-a127-00e1e87adeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1544523560',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=029fdf0a-7d5f-4879-843a-0acac4dfdfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:14Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.606785 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742fd4af-7435-49de-82b3-2dd3f86c72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.626791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742fd4af-7435-49de-82b3-2dd3f86c72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.633707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e7e7fe-7a1f-4c4b-a9b9-6c24df6af5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.639239 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e7e7fe-7a1f-4c4b-a9b9-6c24df6af5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '029fdf0a-7d5f-4879-843a-0acac4dfdfa2', 'volume_name': 'volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.646620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675ed68-56ef-471d-9173-d1127c61a091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.651779 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2675ed68-56ef-471d-9173-d1127c61a091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.659898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cbd491-3172-4a73-a60f-ebc156af70d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.661273 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Volume 029fdf0a-7d5f-4879-843a-0acac4dfdfa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2', 'volume_size': 1}
Apr 02 21:18:14.662079 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] creating volume 'volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:14.663110 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:14.761461 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:14.761903 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:14.769628 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cbd491-3172-4a73-a60f-ebc156af70d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.779844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79714f3-148c-4a3a-9165-92fa6af9f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:14.798187 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Volume volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2 (029fdf0a-7d5f-4879-843a-0acac4dfdfa2): created successfully
Apr 02 21:18:14.803542 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79714f3-148c-4a3a-9165-92fa6af9f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:14.829310 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (242d0149-d901-4764-a9d1-1218604abf8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:14.859059 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e9566742-2ed6-49da-97ce-054acd147241 tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:15.666404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-029fdf0a-7d5f-4879-843a-0acac4dfdfa2-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:15.703724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:15.759357 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:15.760177 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Volume volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:15.766595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-029fdf0a-7d5f-4879-843a-0acac4dfdfa2 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:16.121186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Created reservations ['0c1f5920-837d-43fd-a43a-d9a116f6d243', '9521fa45-8ad8-4898-be71-a47b46b530bf', '0834ae5d-94bc-4461-b31e-f25076130661', '44a0095b-838d-4aac-b0b1-1defdc5dfe6a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:16.205463 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:16.244608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:16.320319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:16.340685 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:16.372780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-10e509aa-20e9-4295-a553-52a0562a1b7c tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-029fdf0a-7d5f-4879-843a-0acac4dfdfa2-delete_volume'" released by "delete_volume" :: held 0.706s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:16.873216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-81cb38df-1e06-4b52-97e1-4547ef5413f9-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:16.939011 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:17.031799 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:17.032240 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Volume volume-81cb38df-1e06-4b52-97e1-4547ef5413f9 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:17.051880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-81cb38df-1e06-4b52-97e1-4547ef5413f9 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:17.477636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Created reservations ['29936e93-3106-43d5-99a6-565a3f4c1d34', '46039169-3a43-4920-a3c8-1a2ecb4b1c98', '565c8acb-7524-46b8-b8ab-14086d12fcdd', 'fc9345da-25c5-46a3-9225-410fd81cb093'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:17.538618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:17.590668 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:17.638168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:17.647260 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:17.662551 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1c044369-d8aa-453d-84e3-7210d8fe3092 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-81cb38df-1e06-4b52-97e1-4547ef5413f9-delete_volume'" released by "delete_volume" :: held 0.789s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:18.586244 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:18.620910 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (0787389a-a629-48ae-a966-59fce85a15b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:18.634604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e705e81-3f6f-4c68-ad28-b84f92c5fc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.660635 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e705e81-3f6f-4c68-ad28-b84f92c5fc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1236670746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=485dfd7b-0ca5-4586-b917-18c5430eee12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:19Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.670735 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2823cb7-ca1c-478e-a192-cfb03c35b1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.678236 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2823cb7-ca1c-478e-a192-cfb03c35b1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.685025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1b39c-fa04-4a8b-9c8b-89523ae48e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.689868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1b39c-fa04-4a8b-9c8b-89523ae48e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '485dfd7b-0ca5-4586-b917-18c5430eee12', 'volume_name': 'volume-485dfd7b-0ca5-4586-b917-18c5430eee12', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.695323 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f14ea9-1da7-4e27-88f5-4de1d84fd0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.700826 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f14ea9-1da7-4e27-88f5-4de1d84fd0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.713689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6c23e0-9647-4564-811d-b5551872c738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.715890 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Volume 485dfd7b-0ca5-4586-b917-18c5430eee12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-485dfd7b-0ca5-4586-b917-18c5430eee12', 'volume_size': 1}
Apr 02 21:18:18.716587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] creating volume 'volume-485dfd7b-0ca5-4586-b917-18c5430eee12' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:18.719332 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:18.874334 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:18.874717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:18.878923 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff6c23e0-9647-4564-811d-b5551872c738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-485dfd7b-0ca5-4586-b917-18c5430eee12', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.883950 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78480144-e04d-4fad-a978-5866b9695945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:18.905332 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Volume volume-485dfd7b-0ca5-4586-b917-18c5430eee12 (485dfd7b-0ca5-4586-b917-18c5430eee12): created successfully
Apr 02 21:18:18.909646 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78480144-e04d-4fad-a978-5866b9695945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:18.921386 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (0787389a-a629-48ae-a966-59fce85a15b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:18.943373 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1953b647-5021-42e8-9d20-8e1c883b7bee tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:20.199861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:20.246691 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (baced87f-9bd5-41e3-a916-62cfef6ad962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:20.260312 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a5ee51-1879-402c-bbfc-ceaa6692e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:20.289810 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a5ee51-1879-402c-bbfc-ceaa6692e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-973596502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e32902f7-2d46-4004-bcd0-b6ca07f89a7a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=485dfd7b-0ca5-4586-b917-18c5430eee12,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:20Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:20.319639 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7253967-45e6-4034-8fa9-27afa24da8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:20.324245 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7253967-45e6-4034-8fa9-27afa24da8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:20.330032 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e41e4-3343-4fa4-a733-6ac604e84880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:20.351127 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e41e4-3343-4fa4-a733-6ac604e84880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e32902f7-2d46-4004-bcd0-b6ca07f89a7a', 'volume_name': 'volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a', 'volume_size': 1, 'source_volid': '485dfd7b-0ca5-4586-b917-18c5430eee12', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:20.358157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877f6b45-50c3-4369-b54a-50c8b32626c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:20.363389 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877f6b45-50c3-4369-b54a-50c8b32626c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:20.369752 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094d3f35-7602-476f-a5f3-113b205f0027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:20.371727 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Volume e32902f7-2d46-4004-bcd0-b6ca07f89a7a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a', 'volume_size': 1, 'source_volid': '485dfd7b-0ca5-4586-b917-18c5430eee12', 'source_volstatus': 'available'}
Apr 02 21:18:20.386128 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:20.486286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] creating snapshot='volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:18:21.313789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] cloning 'volume-485dfd7b-0ca5-4586-b917-18c5430eee12@volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a.clone_snap' to 'volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:18:21.479057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Volume volume-485dfd7b-0ca5-4586-b917-18c5430eee12 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:21.481432 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:21.481911 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:21.518404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:18:21.536425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094d3f35-7602-476f-a5f3-113b205f0027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a', 'volume_size': 1, 'source_volid': '485dfd7b-0ca5-4586-b917-18c5430eee12', 'source_volstatus': 'available'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:21.542087 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e90a33-cfa2-43dd-bca1-6fae01ae3614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:21.553043 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Volume volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a (e32902f7-2d46-4004-bcd0-b6ca07f89a7a): created successfully
Apr 02 21:18:21.557974 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e90a33-cfa2-43dd-bca1-6fae01ae3614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:21.564604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (baced87f-9bd5-41e3-a916-62cfef6ad962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:21.583908 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c3bdd959-102f-4b4b-8e6a-ba607f88e136 tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:22.945279 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:22.978363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (42fcb3c2-487e-4f3f-b3d2-05e6e3a2852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:22.988087 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523b4892-589d-4ca5-aa15-c09fbe097296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.017688 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523b4892-589d-4ca5-aa15-c09fbe097296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1905077191',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:23Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.024523 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baff97e8-313a-4255-baba-78c64c93e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.029641 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baff97e8-313a-4255-baba-78c64c93e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.036650 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2cdd60-641e-47d9-9ce8-52ca8a14a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.041621 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2cdd60-641e-47d9-9ce8-52ca8a14a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c', 'volume_name': 'volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.048206 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d58328-32f2-400f-bb34-668cda32af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.053652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d58328-32f2-400f-bb34-668cda32af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.058610 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeaf454-dd69-4274-9a14-915430995e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.060636 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Volume 6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c', 'volume_size': 1}
Apr 02 21:18:23.061211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] creating volume 'volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:23.062547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:23.148433 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:23.148851 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:23.152876 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeaf454-dd69-4274-9a14-915430995e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.157776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc380d-5cca-49fc-9dad-03c9368f8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:23.174980 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Volume volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c (6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c): created successfully
Apr 02 21:18:23.179428 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cc380d-5cca-49fc-9dad-03c9368f8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:23.195653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (42fcb3c2-487e-4f3f-b3d2-05e6e3a2852c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:23.228883 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-90a7ba6b-ce3f-4857-8702-9ce3ba831156 tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:24.071407 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:24.119398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:24.175858 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:24.176756 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Volume volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:24.185886 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:24.597089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Created reservations ['4d74148f-646f-43b0-afbe-6eeacab2a05f', '60bd142d-ede8-4fd6-8886-ef0f3007e894', '583f2020-63f2-4981-8d47-08b6504a4542', 'ac9825b1-0923-4b13-9f3f-6b3584caefd6'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:24.653702 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:24.729222 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:24.806519 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:24.811877 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:24.835475 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-37c84d97-66f2-4b61-a1ce-49c3f0af71a3 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-6ec33879-61ad-4e1a-85b3-c3fbcc12fb2c-delete_volume'" released by "delete_volume" :: held 0.765s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:25.278130 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-e32902f7-2d46-4004-bcd0-b6ca07f89a7a-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:25.363058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:25.502360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:25.516580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:25.914689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:18:25.945136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Volume volume-485dfd7b-0ca5-4586-b917-18c5430eee12 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:25.945851 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] deleting parent snapshot volume-e32902f7-2d46-4004-bcd0-b6ca07f89a7a.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:18:26.607391 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Created reservations ['9781cbb1-1d8d-4e7c-8986-efffbcf68708', '2e4d7e33-6c6f-4b43-89ef-4b147e2142f9', '5581b53d-550b-48c2-9f68-feada2c253f0', '640032fc-8558-44dc-82ed-322ac3d1f272'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:26.684401 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:26.735759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:26.781747 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:26.788978 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:26.807671 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-491f3465-b70f-42ee-a7bc-121346bcecdf tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-e32902f7-2d46-4004-bcd0-b6ca07f89a7a-delete_volume'" released by "delete_volume" :: held 1.530s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:28.472601 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:28.525339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (13e6efc5-cf82-41e9-8e94-8d024f1cffa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:28.545713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db283c7b-9a05-4a2b-8fe5-45ac50a13e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:28.590556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db283c7b-9a05-4a2b-8fe5-45ac50a13e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1476404875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b0d49a1c-a0a0-4435-9fee-1511e5fa493b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:28Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:28.598757 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5169b5-0030-4a0c-89ab-f0b207be9454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:28.617106 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5169b5-0030-4a0c-89ab-f0b207be9454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:28.638254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e80e80-dc82-4de2-820a-b4be203a1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:28.764071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e80e80-dc82-4de2-820a-b4be203a1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0d49a1c-a0a0-4435-9fee-1511e5fa493b', 'volume_name': 'volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe296f95940>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:28.788003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b538a37-32a8-4aa4-a25e-c9fa607e622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:28.826879 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b538a37-32a8-4aa4-a25e-c9fa607e622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:28.842678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d15c698-43d6-43b6-95fb-c350beba930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:28.866348 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Volume b0d49a1c-a0a0-4435-9fee-1511e5fa493b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe296f95940>}
Apr 02 21:18:28.867149 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Cloning b0d49a1c-a0a0-4435-9fee-1511e5fa493b from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:18:28.911176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.034s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:28.935959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 18, 28, 926027)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:18:28.936413 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:18:28.936926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:18:28.944949 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.042s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:28.946298 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:18:28.961654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 18, 28, 955571)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:18:28.962090 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:18:28.962571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:18:29.005135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:29.124914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] creating snapshot='volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:18:29.268335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b.clone_snap' to 'volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:18:29.273472 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:18:29.279618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:29.390259 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:29.462028 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:29.562396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:29.563494 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:29.563868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:29.602478 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:18:29.603371 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Marking volume b0d49a1c-a0a0-4435-9fee-1511e5fa493b as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:18:29.616180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to b0d49a1c-a0a0-4435-9fee-1511e5fa493b. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:18:29.617104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Creating volume glance metadata for volume b0d49a1c-a0a0-4435-9fee-1511e5fa493b backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:18:29.729076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d15c698-43d6-43b6-95fb-c350beba930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe296f95940>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:29.736809 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56e3bc-30cc-4033-a83c-a6372c099042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:29.750366 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Volume volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b (b0d49a1c-a0a0-4435-9fee-1511e5fa493b): created successfully
Apr 02 21:18:29.765567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed56e3bc-30cc-4033-a83c-a6372c099042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:29.772778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (13e6efc5-cf82-41e9-8e94-8d024f1cffa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:29.786608 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b0642e53-b694-4534-9e59-2ab034d382aa tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:31.258787 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:31.325856 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (9e5ed366-2e9a-4916-b382-7d66c40c654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:31.348494 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd1a9af-c871-4a24-8fcf-7d996a662b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.393966 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd1a9af-c871-4a24-8fcf-7d996a662b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-559054490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bc1306bb-c753-40f0-8c31-125995c8dbef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e70585684cfd47abaefc439b16236ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:31Z,use_quota=True,user_id='00a94eccf6414721a36224e438a392de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.399871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb6c45c-8017-4a10-8127-b7cf4f7e3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.413175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb6c45c-8017-4a10-8127-b7cf4f7e3984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.435801 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1925d-f4be-4c2b-91ef-1319e117249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.443422 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1925d-f4be-4c2b-91ef-1319e117249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1306bb-c753-40f0-8c31-125995c8dbef', 'volume_name': 'volume-bc1306bb-c753-40f0-8c31-125995c8dbef', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.466237 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2f121e-c713-4f55-a0f4-19d50a893441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.483860 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2f121e-c713-4f55-a0f4-19d50a893441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.500388 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ad057-b00b-4406-bad0-7501b43bd25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.514788 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Volume bc1306bb-c753-40f0-8c31-125995c8dbef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1306bb-c753-40f0-8c31-125995c8dbef', 'volume_size': 1}
Apr 02 21:18:31.517212 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] creating volume 'volume-bc1306bb-c753-40f0-8c31-125995c8dbef' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:31.520131 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:31.698500 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:31.699607 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:31.706223 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ad057-b00b-4406-bad0-7501b43bd25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1306bb-c753-40f0-8c31-125995c8dbef', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.727321 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a3db0b-a620-4511-955a-b13bf55c4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.759934 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Volume volume-bc1306bb-c753-40f0-8c31-125995c8dbef (bc1306bb-c753-40f0-8c31-125995c8dbef): created successfully
Apr 02 21:18:31.764636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a3db0b-a620-4511-955a-b13bf55c4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.786510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (9e5ed366-2e9a-4916-b382-7d66c40c654f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:31.826657 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ba384462-f16c-404b-aef9-a7742558c1e4 tempest-VolumesTestJSON-841549220 None] Created volume successfully.
Apr 02 21:18:31.854639 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:31.910652 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (2a660bab-2fba-4ffb-b203-d42c64f5b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:31.928420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d064d8a2-0146-4fbd-9991-9d0698b62eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.962776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d064d8a2-0146-4fbd-9991-9d0698b62eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1113053073',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ef5ab3fb-b5f2-451b-88c5-140df49dfd69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce8744f73784c569b7e4dc524d5b011',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:32Z,use_quota=True,user_id='5e3c9dbc7fca49ebb2f99d0d7a4ca12a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:31.974604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5708ffcb-ae25-4e46-b5d1-eb34881da288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:31.980620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5708ffcb-ae25-4e46-b5d1-eb34881da288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:32.006104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95741f2-9aa1-468a-bdc9-a2c124831c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:32.010995 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95741f2-9aa1-468a-bdc9-a2c124831c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5ab3fb-b5f2-451b-88c5-140df49dfd69', 'volume_name': 'volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:32.017925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f697514-5934-4a1a-b8d2-89e800c40675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:32.021966 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f697514-5934-4a1a-b8d2-89e800c40675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:32.026791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cacf0c-c3ef-4eec-9df2-6f858f297e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:32.027921 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Volume ef5ab3fb-b5f2-451b-88c5-140df49dfd69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69', 'volume_size': 1}
Apr 02 21:18:32.028310 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] creating volume 'volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:32.045003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:32.161583 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:32.161871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:32.166038 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cacf0c-c3ef-4eec-9df2-6f858f297e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:32.171804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584687ec-8c72-4a13-a9e0-65ffc2369129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:32.202270 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Volume volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69 (ef5ab3fb-b5f2-451b-88c5-140df49dfd69): created successfully
Apr 02 21:18:32.206869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584687ec-8c72-4a13-a9e0-65ffc2369129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:32.218723 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Flow 'volume_create_manager' (2a660bab-2fba-4ffb-b203-d42c64f5b708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:32.237263 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-52fa195a-68b2-4b16-8dae-65bece82b7b5 tempest-VolumesGetTest-2095585821 None] Created volume successfully.
Apr 02 21:18:32.938315 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-ef5ab3fb-b5f2-451b-88c5-140df49dfd69-delete_volume'" acquired by "delete_volume" :: waited 0.050s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:33.032083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:33.052044 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (14fe9398-bda3-487e-b145-fb922fb38e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:33.062778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af8c490-f87d-4ee1-9b9d-30a0ae147730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.093749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af8c490-f87d-4ee1-9b9d-30a0ae147730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-422434559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=21625544-2ad1-4dad-b3ef-5d1b49c86fc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e70585684cfd47abaefc439b16236ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:33Z,use_quota=True,user_id='00a94eccf6414721a36224e438a392de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.099630 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fb20b8-35ef-4ef4-aaa4-5a58b696f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.104608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7fb20b8-35ef-4ef4-aaa4-5a58b696f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.111097 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b85cec3-5a2d-4bdf-9e8c-90e649446b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.119340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b85cec3-5a2d-4bdf-9e8c-90e649446b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21625544-2ad1-4dad-b3ef-5d1b49c86fc8', 'volume_name': 'volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.125393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4256c922-6a30-49a7-8c8b-d7f51e02eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.129632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4256c922-6a30-49a7-8c8b-d7f51e02eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.142072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79283ef9-cb02-4145-9667-6f3401f8c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.143686 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Volume 21625544-2ad1-4dad-b3ef-5d1b49c86fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8', 'volume_size': 1}
Apr 02 21:18:33.143991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] creating volume 'volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:33.144982 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:33.189609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:33.268665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:33.268665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Volume volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:33.280937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-ef5ab3fb-b5f2-451b-88c5-140df49dfd69 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:33.290791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:33.291146 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:33.301697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79283ef9-cb02-4145-9667-6f3401f8c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.306689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf11670-d307-4ada-8b53-422c0f0a392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:33.327103 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Volume volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8 (21625544-2ad1-4dad-b3ef-5d1b49c86fc8): created successfully
Apr 02 21:18:33.331540 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf11670-d307-4ada-8b53-422c0f0a392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:33.340297 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (14fe9398-bda3-487e-b145-fb922fb38e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:33.354660 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2b03418b-416a-4a96-a01f-3fccba3bf57d tempest-VolumesTestJSON-841549220 None] Created volume successfully.
Apr 02 21:18:33.613075 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Created reservations ['70f99eda-5157-4a58-ace5-cba9969d96c9', '642d6035-c3f1-424f-9a19-5a2fda9c21b5', '16dc21f3-b60b-4cde-9e75-f547c8a82fcd', '8f240044-62ea-419c-8c01-ffe0bd633e28'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:33.687715 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:33.743224 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:33.806447 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:33.819140 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:33.837564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-db5003e9-f7d2-4519-9794-cd02b9d359cc tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-ef5ab3fb-b5f2-451b-88c5-140df49dfd69-delete_volume'" released by "delete_volume" :: held 0.899s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:34.133007 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-b0d49a1c-a0a0-4435-9fee-1511e5fa493b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:34.216179 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:34.342503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:34.353432 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:34.735181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:18:34.777057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] deleting parent snapshot volume-b0d49a1c-a0a0-4435-9fee-1511e5fa493b.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:18:35.605380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:35.629569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (5dce9d26-8147-4e0a-8b98-70dce80f44ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:35.637915 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2693c6c9-b7d2-4c47-a39d-48a12e9e3c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.663214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2693c6c9-b7d2-4c47-a39d-48a12e9e3c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2074884399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=45f1cc1d-7fab-4246-9d6c-969ad517b3f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e70585684cfd47abaefc439b16236ae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:35Z,use_quota=True,user_id='00a94eccf6414721a36224e438a392de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.669461 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803a3af-754f-46cf-aabb-56452b96cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.674592 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d803a3af-754f-46cf-aabb-56452b96cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.695715 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037506e6-391a-4533-990f-bcfd62b9f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.706948 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037506e6-391a-4533-990f-bcfd62b9f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f1cc1d-7fab-4246-9d6c-969ad517b3f0', 'volume_name': 'volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.719315 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d4190d-f8b2-4bd9-bb0c-2882f59b32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.731876 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d4190d-f8b2-4bd9-bb0c-2882f59b32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.738750 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65efc6-d286-428a-8b26-f8d9071280e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.740274 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Volume 45f1cc1d-7fab-4246-9d6c-969ad517b3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0', 'volume_size': 1}
Apr 02 21:18:35.740977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] creating volume 'volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:35.742176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:35.805582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] Created reservations ['a9d67173-b257-4361-b9fb-825e0837dce7', '8717a892-2349-462e-9116-1c79e8392a41', 'c78d8545-f764-4a3a-b8f4-9fad8055b78f', '2af66a43-e14b-41c1-b8ec-91a7b1a0be05'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:35.889086 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:35.889640 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:35.895209 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc65efc6-d286-428a-8b26-f8d9071280e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.900976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929504a7-5a9f-4b10-aa4e-a94dc01838a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:35.922498 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Volume volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0 (45f1cc1d-7fab-4246-9d6c-969ad517b3f0): created successfully
Apr 02 21:18:35.927214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929504a7-5a9f-4b10-aa4e-a94dc01838a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:35.934308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Flow 'volume_create_manager' (5dce9d26-8147-4e0a-8b98-70dce80f44ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:35.955975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:36.006884 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:36.080245 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:36.088696 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:36.095831 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-20e5e5bd-ae15-4a61-985d-f648cec9a44e tempest-VolumesTestJSON-841549220 None] Created volume successfully.
Apr 02 21:18:36.117185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a14a933d-2521-45b2-8df0-34062a6091b2 tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-b0d49a1c-a0a0-4435-9fee-1511e5fa493b-delete_volume'" released by "delete_volume" :: held 1.985s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:36.123797 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-74519e3f-5a72-42de-b981-34298e27b3fd tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['c1beb954-8bbd-4626-b52f-06d3fe476fea', '6f43d0ee-2727-4059-930e-c0114c159ebf', 'f1093d58-5aa1-4bcc-88ad-eda8a4aad3f5', 'a9a55315-607b-40b4-822a-af181a25b83a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:36.195322 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-74519e3f-5a72-42de-b981-34298e27b3fd tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:18:36.205477 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-74519e3f-5a72-42de-b981-34298e27b3fd tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-c39b2b1a-1b0b-43e5-8618-80834d27cc4b-delete_snapshot'" released by "delete_snapshot" :: held 30.584s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:36.427892 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-485dfd7b-0ca5-4586-b917-18c5430eee12-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:36.528539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:36.631991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:36.632692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Volume volume-485dfd7b-0ca5-4586-b917-18c5430eee12 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:36.648547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] deleting rbd volume volume-485dfd7b-0ca5-4586-b917-18c5430eee12 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:37.158186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Created reservations ['8c762db0-1a5a-4aa5-ab6f-4126cad30dcb', '3ce42907-8ec0-4b58-9ce0-88abdf3233f8', '31638f10-5232-4f98-adf2-51833841cd14', '6c995fc8-0647-4bd6-84a7-540b8cc1774c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:37.263922 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:37.337615 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:37.396441 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:37.412256 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Deleted volume successfully.
Apr 02 21:18:37.439577 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1d881fac-abcd-47f9-af68-8acc4dcb921b tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-cf735ae6-478e-43b4-b94f-122177202486-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.034s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:37.442531 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1d881fac-abcd-47f9-af68-8acc4dcb921b tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:37.539404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1a92fdf3-9442-44a9-8252-a24a9d401cfc tempest-VolumesGetTest-2095585821 None] Lock "b'cinder-485dfd7b-0ca5-4586-b917-18c5430eee12-delete_volume'" released by "delete_volume" :: held 1.112s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:38.709784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-45f1cc1d-7fab-4246-9d6c-969ad517b3f0-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:38.786723 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:38.872182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:38.872532 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Volume volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:38.888939 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] deleting rbd volume volume-45f1cc1d-7fab-4246-9d6c-969ad517b3f0 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:39.468046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Created reservations ['211aec46-66fe-4fb5-8599-a8a4a807a906', '66763aa9-d83a-4439-b94d-658036df21d8', 'c8159554-66ac-466c-b2a4-38bdc80896d2', '800daf79-88d9-402d-8511-e5b7c1ce364a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:39.586403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:39.666667 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:39.731466 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:39.735939 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Deleted volume successfully.
Apr 02 21:18:39.751623 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-64173b76-e191-4133-abf9-2036d662ac1f tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-45f1cc1d-7fab-4246-9d6c-969ad517b3f0-delete_volume'" released by "delete_volume" :: held 1.042s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:40.063579 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-21625544-2ad1-4dad-b3ef-5d1b49c86fc8-delete_volume'" acquired by "delete_volume" :: waited 0.051s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:40.237934 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:40.300415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:40.300911 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Volume volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:40.317202 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] deleting rbd volume volume-21625544-2ad1-4dad-b3ef-5d1b49c86fc8 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:40.907804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Created reservations ['1559d60c-7df3-49c4-86df-a3c1b09c3f66', '9e0b66db-e695-4517-a682-6b1de0dc2b07', '0c874cdf-474d-444c-a9d7-ad6b6e9f041d', '7496d716-c204-411e-89c5-31e732bd683a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:41.024816 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:41.105829 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:41.162066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:41.171326 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Deleted volume successfully.
Apr 02 21:18:41.189507 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7396ec8b-1c8a-42e1-b5ca-032a4f09148a tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-21625544-2ad1-4dad-b3ef-5d1b49c86fc8-delete_volume'" released by "delete_volume" :: held 1.127s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:41.362800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-bc1306bb-c753-40f0-8c31-125995c8dbef-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:41.453451 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:41.566596 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:41.567256 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Volume volume-bc1306bb-c753-40f0-8c31-125995c8dbef is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:41.597960 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] deleting rbd volume volume-bc1306bb-c753-40f0-8c31-125995c8dbef {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:42.147854 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Created reservations ['d889c7df-702c-431a-9020-bd0d3639ad83', '2414f70a-f0fe-4bb8-adf8-532a247fbe56', 'b840a458-d323-4631-848b-603f4c8b9318', '78b7200a-9e7d-4cec-9128-2b54c120d298'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:42.235008 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:42.327771 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:42.401001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:42.405704 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Deleted volume successfully.
Apr 02 21:18:42.430480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e5fcbd7b-db08-4020-900d-72f219d53d7d tempest-VolumesTestJSON-841549220 None] Lock "b'cinder-bc1306bb-c753-40f0-8c31-125995c8dbef-delete_volume'" released by "delete_volume" :: held 1.067s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:43.083837 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:18:43.142556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Flow 'volume_create_manager' (a77dcd97-e633-4cdf-902c-9d4c217d9b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:43.182308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4c621-f2c5-4345-b331-bb7a5be8dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.224992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c4c621-f2c5-4345-b331-bb7a5be8dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1104545474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0275967f-ac84-4432-ab56-48ca8e907c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e800c1df9c74462ea992a2316cf1eb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:18:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:18:43Z,use_quota=True,user_id='367fbc336ceb487d967b92dc50a4310d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.241072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33316e9-3edd-4bd6-aee8-906765cb79f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.253992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33316e9-3edd-4bd6-aee8-906765cb79f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.263620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d95e0f7-19da-4408-95ef-2c070d75ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.270172 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d95e0f7-19da-4408-95ef-2c070d75ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0275967f-ac84-4432-ab56-48ca8e907c8c', 'volume_name': 'volume-0275967f-ac84-4432-ab56-48ca8e907c8c', 'volume_size': 2}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.294677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246fe577-3f90-4c88-ba3e-26d50389a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.303850 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246fe577-3f90-4c88-ba3e-26d50389a475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.334998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b272263c-2225-4e5f-8e1b-8b32fe264b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.336753 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Volume 0275967f-ac84-4432-ab56-48ca8e907c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0275967f-ac84-4432-ab56-48ca8e907c8c', 'volume_size': 2}
Apr 02 21:18:43.337850 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] creating volume 'volume-0275967f-ac84-4432-ab56-48ca8e907c8c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:18:43.339300 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:43.491307 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:18:43.492138 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:18:43.496046 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b272263c-2225-4e5f-8e1b-8b32fe264b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0275967f-ac84-4432-ab56-48ca8e907c8c', 'volume_size': 2}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.501855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba6c28b-58ca-4569-b7b1-e01bd0fa9ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:18:43.521212 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Volume volume-0275967f-ac84-4432-ab56-48ca8e907c8c (0275967f-ac84-4432-ab56-48ca8e907c8c): created successfully
Apr 02 21:18:43.529419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba6c28b-58ca-4569-b7b1-e01bd0fa9ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:18:43.552268 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Flow 'volume_create_manager' (a77dcd97-e633-4cdf-902c-9d4c217d9b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:18:43.573313 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0025ecf6-530f-4cf8-8c22-3df571f2cb40 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Created volume successfully.
Apr 02 21:18:44.392485 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-2ced4014-0413-4748-ad8e-c604c6c77d38 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:45.431927 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-2ced4014-0413-4748-ad8e-c604c6c77d38 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Create snapshot completed successfully
Apr 02 21:18:46.635749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-609bc550-bc20-497e-b1c2-7b9215d6b465 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Lock "b'cinder-5988fb77-ad7c-4c05-ac1b-91d534ae7caf-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:46.637225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-609bc550-bc20-497e-b1c2-7b9215d6b465 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:47.502038 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-609bc550-bc20-497e-b1c2-7b9215d6b465 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Created reservations ['ab89a1e5-37d5-4462-a114-51a207a3c194', '01e0702c-795d-477f-8c70-114c11cac412', 'e708b7d4-602d-4194-bbf1-bb85009283e3', '105c97fb-1005-4ae0-be9a-94a3d02b5c4f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:47.608827 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-609bc550-bc20-497e-b1c2-7b9215d6b465 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Delete snapshot completed successfully.
Apr 02 21:18:47.614394 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-609bc550-bc20-497e-b1c2-7b9215d6b465 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Lock "b'cinder-5988fb77-ad7c-4c05-ac1b-91d534ae7caf-delete_snapshot'" released by "delete_snapshot" :: held 0.979s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:18:47.851669 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Lock "b'cinder-0275967f-ac84-4432-ab56-48ca8e907c8c-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:18:47.956966 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:48.043855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:18:48.044714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Volume volume-0275967f-ac84-4432-ab56-48ca8e907c8c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:18:48.061832 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] deleting rbd volume volume-0275967f-ac84-4432-ab56-48ca8e907c8c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:18:48.644060 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Created reservations ['5b8bb570-9ad5-47b7-8cfd-5dc6d193b442', '09ec0458-fafe-41e8-aa89-b37a9fc54d05', '9952e3f5-32d0-4582-bf26-17494089247a', 'f7e52b61-6104-4f41-bce4-765b8a9d45a6'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:18:48.732502 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:48.817220 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:18:48.904079 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:18:48.910654 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Deleted volume successfully.
Apr 02 21:18:48.937937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f0eb4ae8-e9bc-4ace-beed-17d41e948a64 tempest-VolumesSnapshotNegativeTestJSON-1442216368 None] Lock "b'cinder-0275967f-ac84-4432-ab56-48ca8e907c8c-delete_volume'" released by "delete_volume" :: held 1.086s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:07.757317 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-1d881fac-abcd-47f9-af68-8acc4dcb921b tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['3a16b8e5-f6f1-4cb2-b0f2-5a5b84e7d8b7', '3286c040-0ec3-4e0e-81b0-4c40b3d7aa7c', 'edcc9879-c04f-4e46-9f72-90264dc91ce0', 'a1c8acf6-8ad2-4c86-98d5-035321df8265'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:07.826699 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1d881fac-abcd-47f9-af68-8acc4dcb921b tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:19:07.835229 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1d881fac-abcd-47f9-af68-8acc4dcb921b tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-cf735ae6-478e-43b4-b94f-122177202486-delete_snapshot'" released by "delete_snapshot" :: held 30.394s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:09.464717 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-b5ec849a-0c1c-4691-9bc9-42544524387f req-e133d403-4f74-4461-ab16-858c40041de0 tempest-VolumesSnapshotTestJSON-244026219 None] Terminate volume connection completed successfully.
Apr 02 21:19:09.465755 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-b5ec849a-0c1c-4691-9bc9-42544524387f req-e133d403-4f74-4461-ab16-858c40041de0 tempest-VolumesSnapshotTestJSON-244026219 None] Deleting attachment 2f15a059-fe81-4cd1-b60b-7dbed3763589. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:19:15.711273 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:15.749730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (29d61e5e-752f-4e23-a679-e0a397fcba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:15.761396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0010daa9-7195-4b87-808f-babb0802efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:15.800551 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0010daa9-7195-4b87-808f-babb0802efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2122787234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=49004bc9-fc14-44d1-91aa-2acfad372280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:16Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:15.820709 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557c5a1-0aff-4491-be93-1ea5f3178084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:15.829561 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557c5a1-0aff-4491-be93-1ea5f3178084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:15.836342 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71450ec1-55ab-42c8-b879-7e7d41109e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:15.841341 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71450ec1-55ab-42c8-b879-7e7d41109e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49004bc9-fc14-44d1-91aa-2acfad372280', 'volume_name': 'volume-49004bc9-fc14-44d1-91aa-2acfad372280', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:15.851771 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c31354b-b68b-40ee-ba8e-c695bb5ef342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:15.861698 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c31354b-b68b-40ee-ba8e-c695bb5ef342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:15.874812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1747ebb-177d-4915-b3f9-d5d6501b0488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:15.876827 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Volume 49004bc9-fc14-44d1-91aa-2acfad372280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49004bc9-fc14-44d1-91aa-2acfad372280', 'volume_size': 1}
Apr 02 21:19:15.878026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] creating volume 'volume-49004bc9-fc14-44d1-91aa-2acfad372280' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:19:15.880207 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:16.053656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:16.054174 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:16.059335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1747ebb-177d-4915-b3f9-d5d6501b0488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49004bc9-fc14-44d1-91aa-2acfad372280', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:16.069427 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4103e6-d447-4a24-bdf1-8cab7428add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:16.094457 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-49004bc9-fc14-44d1-91aa-2acfad372280 (49004bc9-fc14-44d1-91aa-2acfad372280): created successfully
Apr 02 21:19:16.098757 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4103e6-d447-4a24-bdf1-8cab7428add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:16.108662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (29d61e5e-752f-4e23-a679-e0a397fcba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:16.141498 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-73e371d7-53b1-400e-abbd-094eb9cc4cfd tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:19:16.973809 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-647d9e7e-ae64-4927-b25d-eba40c4eb5e0 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:17.703951 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-647d9e7e-ae64-4927-b25d-eba40c4eb5e0 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:19:18.851578 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:18.908377 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (446a26a1-1205-4173-861f-2b4ccaed5eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:18.934367 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ac38fb-9065-4669-9573-e7640af5fc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:18.973265 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ac38fb-9065-4669-9573-e7640af5fc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1405960326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=eee0e6b3-4b22-4762-85fe-0b9ab241bb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9930376c-7b87-4472-bd39-0276b36c4b93,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:19Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:18.981722 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5212838-d729-4f19-b741-5d6a02514500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:18.987775 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5212838-d729-4f19-b741-5d6a02514500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:18.993335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c205c-0ab0-4b51-b2da-050e66e3a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:18.999692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151c205c-0ab0-4b51-b2da-050e66e3a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eee0e6b3-4b22-4762-85fe-0b9ab241bb46', 'volume_name': 'volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46', 'volume_size': 2, 'snapshot_id': '9930376c-7b87-4472-bd39-0276b36c4b93'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:19.006234 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c9b181-f2b8-4a20-bac1-8f8cd94bfc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:19.016481 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c9b181-f2b8-4a20-bac1-8f8cd94bfc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:19.028977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f5b67b-96b7-433b-a9a2-9d70af17a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:19.031133 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Volume eee0e6b3-4b22-4762-85fe-0b9ab241bb46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46', 'volume_size': 2, 'snapshot_id': '9930376c-7b87-4472-bd39-0276b36c4b93'}
Apr 02 21:19:19.091040 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] cloning volumes/volume-49004bc9-fc14-44d1-91aa-2acfad372280@snapshot-9930376c-7b87-4472-bd39-0276b36c4b93 to volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46 {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:19:19.096262 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:19.196018 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:19.426052 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:19.426426 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:19.433158 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:19.665380 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f5b67b-96b7-433b-a9a2-9d70af17a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46', 'volume_size': 2, 'snapshot_id': '9930376c-7b87-4472-bd39-0276b36c4b93'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:19.671819 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d68cfb-eac1-4e64-8f8a-705089154dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:19.687021 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46 (eee0e6b3-4b22-4762-85fe-0b9ab241bb46): created successfully
Apr 02 21:19:19.705865 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d68cfb-eac1-4e64-8f8a-705089154dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:19.714387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (446a26a1-1205-4173-861f-2b4ccaed5eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:19.754900 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f14139a4-62f0-40a7-baa2-c6abaa7f9948 tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:19:21.030202 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-eee0e6b3-4b22-4762-85fe-0b9ab241bb46-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:21.160582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:21.323522 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:21.342822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-eee0e6b3-4b22-4762-85fe-0b9ab241bb46 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:22.005318 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['5c0279c9-9224-4e3c-979a-7ab51086f8ca', '37b9eb5a-ca1e-4b9b-8095-023b45424e3e', '9b733de1-7458-42b5-8b63-907b5b76d070', '9f6eb288-6746-4f36-b375-a843b2baf433'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:22.099670 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:22.233412 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:22.362256 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:22.374512 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:22.409084 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-e46c9e67-633e-48e8-9fa2-32289cc232e5 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-eee0e6b3-4b22-4762-85fe-0b9ab241bb46-delete_volume'" released by "delete_volume" :: held 1.379s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:23.227426 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:23.281862 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (cd3128aa-f9f9-4086-928a-9514ba19ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:23.302877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee5d8d8-f495-4745-b8e7-59f7380f0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.348544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee5d8d8-f495-4745-b8e7-59f7380f0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255937404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cce8e00-1e19-4dc5-ae77-b14daefab808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:23Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.365946 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a292dab-d0cc-4f17-a19f-1f6cb89c0316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.379629 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a292dab-d0cc-4f17-a19f-1f6cb89c0316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.398866 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62962f7-c028-4c9a-8942-4dd0f75fdf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.414941 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62962f7-c028-4c9a-8942-4dd0f75fdf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cce8e00-1e19-4dc5-ae77-b14daefab808', 'volume_name': 'volume-7cce8e00-1e19-4dc5-ae77-b14daefab808', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.425725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2cee72-1604-49cf-bf55-1850620dd500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.443990 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2cee72-1604-49cf-bf55-1850620dd500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.458755 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69763291-6264-41fc-bfef-187148cd5ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.462641 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume 7cce8e00-1e19-4dc5-ae77-b14daefab808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cce8e00-1e19-4dc5-ae77-b14daefab808', 'volume_size': 1}
Apr 02 21:19:23.466680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] creating volume 'volume-7cce8e00-1e19-4dc5-ae77-b14daefab808' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:19:23.467744 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:23.608225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:23.609218 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:23.613956 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69763291-6264-41fc-bfef-187148cd5ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cce8e00-1e19-4dc5-ae77-b14daefab808', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.635797 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4244dc6d-3b35-4137-beda-f05c90099d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:23.656965 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-7cce8e00-1e19-4dc5-ae77-b14daefab808 (7cce8e00-1e19-4dc5-ae77-b14daefab808): created successfully
Apr 02 21:19:23.668543 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4244dc6d-3b35-4137-beda-f05c90099d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:23.689900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (cd3128aa-f9f9-4086-928a-9514ba19ba47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:23.705084 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-16e41832-0f28-4d50-ae8f-e2ad55e121e2 tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:19:24.846560 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7b678e2e-7d04-486c-ab62-0004e403c562 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:25.701247 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7b678e2e-7d04-486c-ab62-0004e403c562 tempest-VolumesSnapshotTestJSON-244026219 None] Create snapshot completed successfully
Apr 02 21:19:26.735759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:26.787616 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (d1512f90-353d-43a0-b164-a1ff22588bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:26.795739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9304bc7c-7f72-4c97-ab17-4cb18da09942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:26.814248 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9304bc7c-7f72-4c97-ab17-4cb18da09942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-955021654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1477b7ee-cc3e-4b89-83a3-c0f94b75767f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fe471f4a924fd98ef24aa24abb736c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a0ea5f7-23cb-4257-82d6-2d03bd87f295,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:27Z,use_quota=True,user_id='08aca3700d594a349789d5f3847894dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:26.820142 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a057ea17-50ef-4d05-b13e-6264a14f7a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:26.826802 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a057ea17-50ef-4d05-b13e-6264a14f7a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:26.836026 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9663f014-a1bc-43cd-9718-5b5a1e379cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:26.842072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9663f014-a1bc-43cd-9718-5b5a1e379cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1477b7ee-cc3e-4b89-83a3-c0f94b75767f', 'volume_name': 'volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f', 'volume_size': 1, 'snapshot_id': '5a0ea5f7-23cb-4257-82d6-2d03bd87f295'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:26.849559 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5893b552-f16a-4006-85c3-0417420b3e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:26.855663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5893b552-f16a-4006-85c3-0417420b3e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:26.875780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe4c61-562e-4682-b5f5-ddbeb26846fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:26.877993 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume 1477b7ee-cc3e-4b89-83a3-c0f94b75767f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f', 'volume_size': 1, 'snapshot_id': '5a0ea5f7-23cb-4257-82d6-2d03bd87f295'}
Apr 02 21:19:26.907388 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] cloning volumes/volume-7cce8e00-1e19-4dc5-ae77-b14daefab808@snapshot-5a0ea5f7-23cb-4257-82d6-2d03bd87f295 to volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:19:26.909009 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:27.004501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:27.234901 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:27.235879 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:27.259932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efe4c61-562e-4682-b5f5-ddbeb26846fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f', 'volume_size': 1, 'snapshot_id': '5a0ea5f7-23cb-4257-82d6-2d03bd87f295'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:27.267065 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9159dc0d-54c9-4fd9-9304-25a243e72f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:27.287337 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f (1477b7ee-cc3e-4b89-83a3-c0f94b75767f): created successfully
Apr 02 21:19:27.302697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9159dc0d-54c9-4fd9-9304-25a243e72f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:27.323207 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Flow 'volume_create_manager' (d1512f90-353d-43a0-b164-a1ff22588bff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:27.353776 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cb24f9b0-b26f-4945-ad60-c86b5248d3b2 tempest-VolumesSnapshotTestJSON-244026219 None] Created volume successfully.
Apr 02 21:19:27.975468 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-1477b7ee-cc3e-4b89-83a3-c0f94b75767f-delete_volume'" acquired by "delete_volume" :: waited 0.033s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:28.019454 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:28.117926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:28.135094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-1477b7ee-cc3e-4b89-83a3-c0f94b75767f {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:28.722056 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['c5532033-d366-46c3-8d88-819111165f73', '25f295e2-4be8-411a-912d-ba3efd7371d8', 'e267ba67-68e6-43ac-b9a8-7e6d966c72fc', '45fd1d85-fbf7-4a6d-923c-248e035cdaf3'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:28.808778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:28.906347 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:28.968772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:28.973812 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:28.992985 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-63215129-0325-4f3c-86a1-b625e09e3f77 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-1477b7ee-cc3e-4b89-83a3-c0f94b75767f-delete_volume'" released by "delete_volume" :: held 1.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:29.268122 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c686d0e2-e47e-4234-9eb6-714a840d9b43 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-5a0ea5f7-23cb-4257-82d6-2d03bd87f295-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:29.270109 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c686d0e2-e47e-4234-9eb6-714a840d9b43 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:29.355853 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:19:29.357415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:29.425844 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:29.490493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:30.804315 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c686d0e2-e47e-4234-9eb6-714a840d9b43 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['4086f8c7-06a7-431e-b7ad-af1757ff4f0d', 'beb91ba0-2f08-48ad-92f7-0c29303ddc35', '465cc596-0ec9-4857-b509-cf32f1833a72', 'fc930997-cdf5-484e-8a36-0104e249ac06'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:30.886678 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c686d0e2-e47e-4234-9eb6-714a840d9b43 tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:19:30.895697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c686d0e2-e47e-4234-9eb6-714a840d9b43 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-5a0ea5f7-23cb-4257-82d6-2d03bd87f295-delete_snapshot'" released by "delete_snapshot" :: held 1.627s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:31.525587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-7cce8e00-1e19-4dc5-ae77-b14daefab808-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:31.588889 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:31.691688 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:31.692128 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-7cce8e00-1e19-4dc5-ae77-b14daefab808 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:19:31.702733 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-7cce8e00-1e19-4dc5-ae77-b14daefab808 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:32.198791 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['9301fd70-0da1-4857-a1ba-5db0d2ff0698', '3198481f-59e7-42d0-9143-f0f4d6ab5b4b', 'd264e172-3cb0-465f-87de-5ef387c724d5', '3e57c546-d74c-4689-b77d-5d1fba7b9608'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:32.258425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:32.326362 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:32.422659 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:32.432692 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:32.455556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4afeb85f-66c3-4a5a-ac2f-08a9c42357c3 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-7cce8e00-1e19-4dc5-ae77-b14daefab808-delete_volume'" released by "delete_volume" :: held 0.925s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:32.800593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4dd30ca5-022b-46a5-8d09-238cf16dfdeb tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-9930376c-7b87-4472-bd39-0276b36c4b93-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.025s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:32.804414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4dd30ca5-022b-46a5-8d09-238cf16dfdeb tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:33.822977 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-4dd30ca5-022b-46a5-8d09-238cf16dfdeb tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['10e955ba-e17c-47d8-a02a-e710fb9666c0', '7fe143ed-97a7-4151-bd26-07f23cda5b0a', '280dccaf-92bb-42d7-ace2-25ca13b5a2d5', '4ff2a5e9-d9d7-426a-8f47-71c9b4514099'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:33.886852 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4dd30ca5-022b-46a5-8d09-238cf16dfdeb tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:19:33.894478 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4dd30ca5-022b-46a5-8d09-238cf16dfdeb tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-9930376c-7b87-4472-bd39-0276b36c4b93-delete_snapshot'" released by "delete_snapshot" :: held 1.094s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:33.948848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-49004bc9-fc14-44d1-91aa-2acfad372280-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:34.006463 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:34.118201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:34.118781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-49004bc9-fc14-44d1-91aa-2acfad372280 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:19:34.128381 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-49004bc9-fc14-44d1-91aa-2acfad372280 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:34.532675 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['4a2f126f-01a1-4bc9-877b-cf942a1afeac', '73803267-7ed8-48a0-a8af-8d0ab322a57b', '96275aab-a5ea-4c13-bcd4-aaa66e872f3c', '9eafff75-6d08-4fea-aeb6-e646a283aae5'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:34.584132 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:34.625582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:34.679919 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:34.685270 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:34.706298 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7d62af9e-169b-46ba-a7ab-c409d0a6a94a tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-49004bc9-fc14-44d1-91aa-2acfad372280-delete_volume'" released by "delete_volume" :: held 0.757s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:35.279076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-8fe875f0-142e-4db8-8a87-f78692047798-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:35.340210 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:35.444627 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:35.460221 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-8fe875f0-142e-4db8-8a87-f78692047798 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:35.795462 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:19:35.832760 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] deleting parent snapshot volume-8fe875f0-142e-4db8-8a87-f78692047798.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:19:36.867628 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['2afac894-a9ce-46a3-8989-f505b95ec8ae', '08bceb9f-4e6e-4482-b594-1c0138ff47f7', '2d44616d-047a-4a11-9493-4d69ccfdb21c', '2c73bd8a-1ffe-4326-b433-e1d4d6e9943d'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:36.955126 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:37.024965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:37.089907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:37.104780 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:37.136493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-d5169311-6aa1-44f7-a154-8ba83e269a80 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-8fe875f0-142e-4db8-8a87-f78692047798-delete_volume'" released by "delete_volume" :: held 1.843s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:37.642486 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bc04b92d-65dd-45bf-839c-3d23ef7ddb46 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-4c2685a2-a52a-4e3c-8955-33dada66c326-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:37.644037 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bc04b92d-65dd-45bf-839c-3d23ef7ddb46 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:38.520251 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:38.540378 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Flow 'volume_create_manager' (17c5cd2d-c39f-4b3e-aa84-f4aa01205fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:38.547846 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25ac670-56d4-49d6-98cb-6e3297cd5ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.564135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25ac670-56d4-49d6-98cb-6e3297cd5ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-384566450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e0efec70-9104-46cd-bfdb-b85c35b1054e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65522f00c7b643fd849d71d36811c75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:38Z,use_quota=True,user_id='fb59fadcc1574a1396fe57c717087461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.569707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ada2e5-0bbf-4b89-b54d-7e2e9343ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.574654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ada2e5-0bbf-4b89-b54d-7e2e9343ab71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.580071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03258865-ab40-484f-81e7-9ccc7fc3a6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.584182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03258865-ab40-484f-81e7-9ccc7fc3a6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0efec70-9104-46cd-bfdb-b85c35b1054e', 'volume_name': 'volume-e0efec70-9104-46cd-bfdb-b85c35b1054e', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.589250 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac8dbe3-deee-4b2a-997b-9825bbb5bdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.593715 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac8dbe3-deee-4b2a-997b-9825bbb5bdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.600268 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fe35de-f698-4449-bd3b-1c07dbf36a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.601329 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Volume e0efec70-9104-46cd-bfdb-b85c35b1054e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0efec70-9104-46cd-bfdb-b85c35b1054e', 'volume_size': 1}
Apr 02 21:19:38.601731 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] creating volume 'volume-e0efec70-9104-46cd-bfdb-b85c35b1054e' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:19:38.603076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:38.669089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:38.670789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:38.675250 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14fe35de-f698-4449-bd3b-1c07dbf36a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0efec70-9104-46cd-bfdb-b85c35b1054e', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.681538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7fa574-4399-493e-ae26-ea86875f3b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:38.695297 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Volume volume-e0efec70-9104-46cd-bfdb-b85c35b1054e (e0efec70-9104-46cd-bfdb-b85c35b1054e): created successfully
Apr 02 21:19:38.703020 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7fa574-4399-493e-ae26-ea86875f3b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:38.712113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Flow 'volume_create_manager' (17c5cd2d-c39f-4b3e-aa84-f4aa01205fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:38.726456 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-11d0bdf2-6a19-4548-957a-8fdc91ab40d9 tempest-VolumesServicesTestJSON-41107023 None] Created volume successfully.
Apr 02 21:19:38.849507 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bc04b92d-65dd-45bf-839c-3d23ef7ddb46 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['3407fc01-4b3d-4294-b7ec-df2181a1146f', 'bbd7573e-3356-472f-8ce7-ecf8f9490837', 'cb053bdc-6b67-4b9d-a5ba-f81ab69296b9', '53acf88a-aace-4b35-8e3e-10a50522c55f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:38.908914 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bc04b92d-65dd-45bf-839c-3d23ef7ddb46 tempest-VolumesSnapshotTestJSON-244026219 None] Delete snapshot completed successfully.
Apr 02 21:19:38.915936 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-bc04b92d-65dd-45bf-839c-3d23ef7ddb46 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-4c2685a2-a52a-4e3c-8955-33dada66c326-delete_snapshot'" released by "delete_snapshot" :: held 1.273s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:39.904295 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Lock "b'cinder-e0efec70-9104-46cd-bfdb-b85c35b1054e-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:39.989539 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-c87f93d6-de80-42a3-9d17-3629759f6c8b-delete_volume'" acquired by "delete_volume" :: waited 0.026s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:40.092384 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:40.198481 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:40.198909 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Volume volume-c87f93d6-de80-42a3-9d17-3629759f6c8b is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:19:40.212529 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] deleting rbd volume volume-c87f93d6-de80-42a3-9d17-3629759f6c8b {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:40.222604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:40.353257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:40.353257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Volume volume-e0efec70-9104-46cd-bfdb-b85c35b1054e is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:19:40.371057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] deleting rbd volume volume-e0efec70-9104-46cd-bfdb-b85c35b1054e {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:40.818663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Created reservations ['aae423dc-dec7-46ac-9049-5f1e4f2bd348', '3cda628b-0c8f-4491-b38d-af7a400b78d8', '3af2e044-949c-4351-b381-44e78e1a2842', 'dac0547b-0979-4a03-8d11-c758215dfd5b'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:40.877558 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:40.916123 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:40.988221 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:41.052740 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Deleted volume successfully.
Apr 02 21:19:41.128676 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-10eb9c52-b9ce-4218-ade0-4fd53fe26d62 tempest-VolumesSnapshotTestJSON-244026219 None] Lock "b'cinder-c87f93d6-de80-42a3-9d17-3629759f6c8b-delete_volume'" released by "delete_volume" :: held 1.138s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:41.130296 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Created reservations ['e32164a3-63ee-4a11-bd38-ade724e915fd', '4d635198-0b23-4016-9cec-b294e91c9c77', '148f769a-a2e0-404c-8d52-9db20f840db3', 'bc5d0231-2a90-4b6d-9e38-288096536988'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:41.180062 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:41.219533 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:41.277340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:41.282799 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Deleted volume successfully.
Apr 02 21:19:41.301954 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-374c022d-e8f4-4387-920b-f5370fdf487f tempest-VolumesServicesTestJSON-41107023 None] Lock "b'cinder-e0efec70-9104-46cd-bfdb-b85c35b1054e-delete_volume'" released by "delete_volume" :: held 1.399s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:50.496425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:50.523094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Flow 'volume_create_manager' (8ee4a5d2-699a-4fec-b623-879f6ba8476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:50.530339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a7455e-a75e-411e-b439-8d43ea8108c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.560559 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a7455e-a75e-411e-b439-8d43ea8108c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2048602140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=765944f9-cf82-4dd2-a301-bf87049116d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d6527a4afc4707b73eec6694d9abe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:50Z,use_quota=True,user_id='6614a53d1e604a958018b23792ee4102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c6c976f-7b4b-4d98-ba39-dbd487ee37b8),volume_type_id=5c6c976f-7b4b-4d98-ba39-dbd487ee37b8)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.566416 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423eb335-01d8-48fc-bf5d-ba814d806b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.571664 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423eb335-01d8-48fc-bf5d-ba814d806b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.577239 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e5cbf9-b583-47d8-8876-f8725800a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.581556 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e5cbf9-b583-47d8-8876-f8725800a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '765944f9-cf82-4dd2-a301-bf87049116d1', 'volume_name': 'volume-765944f9-cf82-4dd2-a301-bf87049116d1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.587414 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e361ac-34e8-4d4a-ae2c-6086dc45140e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.591872 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e361ac-34e8-4d4a-ae2c-6086dc45140e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.596860 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36f0c44-e807-48ba-8f67-5a82b5837f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.598126 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Volume 765944f9-cf82-4dd2-a301-bf87049116d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-765944f9-cf82-4dd2-a301-bf87049116d1', 'volume_size': 1}
Apr 02 21:19:50.598690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] creating volume 'volume-765944f9-cf82-4dd2-a301-bf87049116d1' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:19:50.600171 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:50.688624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:50.689253 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:50.702821 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36f0c44-e807-48ba-8f67-5a82b5837f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765944f9-cf82-4dd2-a301-bf87049116d1', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.719175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c2fe43-4d48-4e03-8485-8a8fafae474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:50.733141 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Volume volume-765944f9-cf82-4dd2-a301-bf87049116d1 (765944f9-cf82-4dd2-a301-bf87049116d1): created successfully
Apr 02 21:19:50.737984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c2fe43-4d48-4e03-8485-8a8fafae474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:50.769534 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Flow 'volume_create_manager' (8ee4a5d2-699a-4fec-b623-879f6ba8476a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:50.775557 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-70c35361-b045-4fd9-b214-b71dd5d2ea44 tempest-VolumeTypesAccessTest-671463130 None] Created volume successfully.
Apr 02 21:19:52.117256 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Lock "b'cinder-765944f9-cf82-4dd2-a301-bf87049116d1-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:19:52.182405 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:52.245564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:19:52.245957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Volume volume-765944f9-cf82-4dd2-a301-bf87049116d1 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:19:52.253560 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] deleting rbd volume volume-765944f9-cf82-4dd2-a301-bf87049116d1 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:19:52.754801 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1573685846 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1573685846, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:19:52.755871 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1573685846 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1573685846, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:19:52.775565 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Created reservations ['c75f87b9-69f0-455a-95e0-9062c1c89c37', '6c6b0d6e-0033-4329-9c65-b58dcd29ef4f', 'be9cf97d-ed27-4047-a5f9-e0158f517a6c', 'b2106c23-1029-46fc-b61f-2177d0035687'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:19:52.848363 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:52.911093 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:52.978914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:19:52.985524 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Deleted volume successfully.
Apr 02 21:19:53.009023 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a7ba0ee9-8d87-4024-8822-d70fea4dee9d tempest-VolumeTypesAccessTest-671463130 None] Lock "b'cinder-765944f9-cf82-4dd2-a301-bf87049116d1-delete_volume'" released by "delete_volume" :: held 0.891s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:19:59.383928 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:19:59.412404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Flow 'volume_create_manager' (c24e12f5-58c2-4e2f-9e0d-5b728b5c6e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:59.423793 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5082a3-6091-417a-8883-47c9a4059d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.461482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5082a3-6091-417a-8883-47c9a4059d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-154763641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2fd55c7f-7435-48f9-b78b-4dd9630a2fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9d8ddc7a19411fa1f94d56527093ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:19:59Z,use_quota=True,user_id='1da0c37af68c4d3fbdec14ca1a86f56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.468078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b080de22-a7d1-4869-baa6-b5974978a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.474815 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b080de22-a7d1-4869-baa6-b5974978a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.483296 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bcc7ec-214e-4e7b-a264-5092a678998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.489474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bcc7ec-214e-4e7b-a264-5092a678998f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd55c7f-7435-48f9-b78b-4dd9630a2fcd', 'volume_name': 'volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.496485 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e5a2a-a310-4711-922c-2c30526a0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.502180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254e5a2a-a310-4711-922c-2c30526a0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.508695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec90c8a-0daf-4e74-9110-ad203613c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.511010 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Volume 2fd55c7f-7435-48f9-b78b-4dd9630a2fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd', 'volume_size': 1}
Apr 02 21:19:59.511694 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] creating volume 'volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:19:59.512725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:19:59.640610 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:19:59.640983 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:19:59.645781 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec90c8a-0daf-4e74-9110-ad203613c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.658732 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac5e95f-347f-4295-91db-1a678c31ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:19:59.679988 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Volume volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd (2fd55c7f-7435-48f9-b78b-4dd9630a2fcd): created successfully
Apr 02 21:19:59.684683 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac5e95f-347f-4295-91db-1a678c31ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:19:59.691749 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Flow 'volume_create_manager' (c24e12f5-58c2-4e2f-9e0d-5b728b5c6e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:19:59.717137 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-ca85cf90-22d6-443e-a860-7ee8d78fad2c tempest-VolumesMetadataTest-1260453681 None] Created volume successfully.
Apr 02 21:20:01.959286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Lock "b'cinder-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:20:02.036862 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:02.144780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:20:02.145751 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Volume volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:20:02.152936 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] deleting rbd volume volume-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:20:02.728678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Created reservations ['5c002927-df54-4d3b-8ebe-3f93c94f0a75', 'e514ab8e-efc9-4c4e-9989-01afc48d48ae', 'e3026aa6-3b4f-4ab4-af9e-cff37ca1286b', 'd8c48cb9-a4a3-4c5b-a5a9-af54ce516b11'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:20:02.886595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:03.010637 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:03.141452 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:20:03.148786 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Deleted volume successfully.
Apr 02 21:20:03.174523 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-71812a8a-113a-46bb-b6bc-4858cf5c7d13 tempest-VolumesMetadataTest-1260453681 None] Lock "b'cinder-2fd55c7f-7435-48f9-b78b-4dd9630a2fcd-delete_volume'" released by "delete_volume" :: held 1.215s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:20:09.534189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:20:09.573825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Flow 'volume_create_manager' (83d0b416-f990-4478-b942-2d4bd84e9ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:09.584787 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911bfb4-2cff-469e-9d8c-095633358b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.604002 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911bfb4-2cff-469e-9d8c-095633358b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1287264950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cd2ad0f-307b-42fa-89c2-ce587c524f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b20c59b847e4929ad209e911bd2f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:20:09Z,use_quota=True,user_id='5a696d517e2c4a08ba14b31f50e452d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.614185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a2f337-a954-41c5-bb88-9e56071f033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.619725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a2f337-a954-41c5-bb88-9e56071f033c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.627696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cc3dc2-a2d2-4a2d-814c-017fb2cb63ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.639131 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cc3dc2-a2d2-4a2d-814c-017fb2cb63ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd2ad0f-307b-42fa-89c2-ce587c524f00', 'volume_name': 'volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.645830 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d6bae8-4ff7-4056-b249-279dfd702400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.652805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d6bae8-4ff7-4056-b249-279dfd702400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.669678 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dbd041-3f86-425e-9cdc-79d8ff2b8c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.679686 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Volume 7cd2ad0f-307b-42fa-89c2-ce587c524f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00', 'volume_size': 1}
Apr 02 21:20:09.680442 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] creating volume 'volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:20:09.682004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:09.869937 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:20:09.870516 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:20:09.874441 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52dbd041-3f86-425e-9cdc-79d8ff2b8c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.881040 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfbf217-4c09-48ad-896f-6f733fa81d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:09.909949 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Volume volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00 (7cd2ad0f-307b-42fa-89c2-ce587c524f00): created successfully
Apr 02 21:20:09.959836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfbf217-4c09-48ad-896f-6f733fa81d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:09.971969 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Flow 'volume_create_manager' (83d0b416-f990-4478-b942-2d4bd84e9ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:09.991996 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bb7a9338-cb58-45a4-8511-b33373b39a73 tempest-VolumesTransfersTest-339604048 None] Created volume successfully.
Apr 02 21:20:11.562624 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-44d502f1-9883-4a63-b3cb-093f217b80fa tempest-VolumesTransfersTest-1181426836 None] Transfer volume completed successfully.
Apr 02 21:20:12.352972 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Lock "b'cinder-7cd2ad0f-307b-42fa-89c2-ce587c524f00-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:20:12.389692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:12.477034 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:20:12.477469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Volume volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:20:12.496962 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] deleting rbd volume volume-7cd2ad0f-307b-42fa-89c2-ce587c524f00 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:20:13.020778 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Created reservations ['12eedd86-e527-4e24-bf5d-596dc964a6ba', '80e98445-e957-4ac3-9749-ab6cd45f813f', 'da204764-5ddb-4d11-ad62-44f19854e235', '706ff8ca-955a-4843-8e22-3fce7eb93579'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:20:13.113794 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:13.177336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:13.238812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:20:13.249257 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Deleted volume successfully.
Apr 02 21:20:13.266377 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f2d551a1-3cf2-4e87-9db6-708592879b79 tempest-VolumesTransfersTest-1045482969 None] Lock "b'cinder-7cd2ad0f-307b-42fa-89c2-ce587c524f00-delete_volume'" released by "delete_volume" :: held 0.913s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:20:13.935129 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:20:13.957206 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Flow 'volume_create_manager' (cccc0047-c599-4ac1-8c49-b95e3bba2c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:13.965169 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605d3c03-ab88-4565-b54d-aaa103f010f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:13.983832 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605d3c03-ab88-4565-b54d-aaa103f010f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-13910536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=af723728-d336-4728-ade3-0c27ec77f759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b20c59b847e4929ad209e911bd2f5e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:20:14Z,use_quota=True,user_id='5a696d517e2c4a08ba14b31f50e452d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:13.995996 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e03380-7dc8-435f-a3d9-6116918b47e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:14.001167 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e03380-7dc8-435f-a3d9-6116918b47e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:14.021067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85c6ba9-8a4e-4153-a6c0-dc15277e155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:14.028804 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85c6ba9-8a4e-4153-a6c0-dc15277e155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af723728-d336-4728-ade3-0c27ec77f759', 'volume_name': 'volume-af723728-d336-4728-ade3-0c27ec77f759', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:14.036210 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccc2dc5-dfb3-4ed2-95e0-02064c25343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:14.043786 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccc2dc5-dfb3-4ed2-95e0-02064c25343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:14.060364 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244decb3-d1b2-4a6d-b0f0-3aeab06abc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:14.063073 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Volume af723728-d336-4728-ade3-0c27ec77f759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af723728-d336-4728-ade3-0c27ec77f759', 'volume_size': 1}
Apr 02 21:20:14.064564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] creating volume 'volume-af723728-d336-4728-ade3-0c27ec77f759' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:20:14.066775 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:14.200787 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:20:14.201365 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:20:14.206603 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244decb3-d1b2-4a6d-b0f0-3aeab06abc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af723728-d336-4728-ade3-0c27ec77f759', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:14.212063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64203c1-e22a-4efb-ba39-e77f80c9c81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:14.229591 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Volume volume-af723728-d336-4728-ade3-0c27ec77f759 (af723728-d336-4728-ade3-0c27ec77f759): created successfully
Apr 02 21:20:14.234452 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64203c1-e22a-4efb-ba39-e77f80c9c81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:14.247469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Flow 'volume_create_manager' (cccc0047-c599-4ac1-8c49-b95e3bba2c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:14.259017 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1b3e7959-6784-433a-a66e-e5e44609fb8f tempest-VolumesTransfersTest-339604048 None] Created volume successfully.
Apr 02 21:20:15.351041 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Lock "b'cinder-af723728-d336-4728-ade3-0c27ec77f759-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:20:15.399998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:15.493707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:20:15.494410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Volume volume-af723728-d336-4728-ade3-0c27ec77f759 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:20:15.504269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] deleting rbd volume volume-af723728-d336-4728-ade3-0c27ec77f759 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:20:15.805866 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Created reservations ['d58a53c0-014f-4a63-b7a9-550d156acecd', '1bf0f8a3-ff6d-41f4-9fd8-ed521fc6bd47', '8624440d-c4aa-49ec-873d-26c1d9dd2271', 'ae17ce90-40ab-49f8-ad03-57de1b6a8758'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:20:15.865326 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:15.905932 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:15.950896 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:20:15.955585 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Deleted volume successfully.
Apr 02 21:20:15.977281 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-964edfde-5e40-439f-8102-749c4b423cb4 tempest-VolumesTransfersTest-1045482969 None] Lock "b'cinder-af723728-d336-4728-ade3-0c27ec77f759-delete_volume'" released by "delete_volume" :: held 0.623s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:20:29.357293 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:20:29.358339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:29.425379 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:29.514708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:20:45.722919 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-702f95a7-7641-4911-ad8a-449397068ba6 tempest-BackendsCapabilitiesAdminTestsJSON-1364141358 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2301e769-c4fa-4abb-81c6-331d5b81bb60:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}}
Apr 02 21:20:45.759743 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-e6c4eabf-0dd5-4669-8029-3f7ae3e03e30 tempest-BackendsCapabilitiesAdminTestsJSON-1364141358 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:2301e769-c4fa-4abb-81c6-331d5b81bb60:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4731}}
Apr 02 21:20:55.635163 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1cf16cc9-663d-47b9-9c72-0f8c4db0174a tempest-GroupSnapshotsV319Test-1132415169 None] Group tempest-GroupSnapshotsV319Test-Group-908846117: creating
Apr 02 21:20:55.656964 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1cf16cc9-663d-47b9-9c72-0f8c4db0174a tempest-GroupSnapshotsV319Test-1132415169 None] Group tempest-GroupSnapshotsV319Test-Group-908846117: created successfully
Apr 02 21:20:55.666395 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1cf16cc9-663d-47b9-9c72-0f8c4db0174a tempest-GroupSnapshotsV319Test-1132415169 None] Create group completed successfully.
Apr 02 21:20:57.163219 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:20:57.186661 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Flow 'volume_create_manager' (937b1aa2-c3f6-43d0-9b6b-21a92f04c0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:57.195605 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe0ed91-f48c-4be7-be85-c439b7f1a11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.213449 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe0ed91-f48c-4be7-be85-c439b7f1a11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-1345665392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=af079ffd-64e4-49e5-af21-34d46adbfaf6,host='ncdv-master-1@ceph#ceph',id=067dd5d4-2cf6-4a88-9bd6-868d6d4158dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='880d022e832643e18f79bf34a0c60b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:20:57Z,use_quota=True,user_id='87bc28a7e503451f85e112d26dbf91aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efaf6797-b2f7-4a0f-9f6d-092359872a53),volume_type_id=efaf6797-b2f7-4a0f-9f6d-092359872a53)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.219503 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f819bc37-3469-4dd4-bcc9-fec9a7c7a820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.234495 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f819bc37-3469-4dd4-bcc9-fec9a7c7a820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.245509 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0ae352-18ba-46fd-8d4c-f77b17f8eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.251168 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0ae352-18ba-46fd-8d4c-f77b17f8eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067dd5d4-2cf6-4a88-9bd6-868d6d4158dd', 'volume_name': 'volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.257908 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1105798d-7549-41dc-a1af-09d509fa416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.262690 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1105798d-7549-41dc-a1af-09d509fa416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.270017 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03058e8c-01cc-4550-98a8-757267f87527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.271308 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Volume 067dd5d4-2cf6-4a88-9bd6-868d6d4158dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd', 'volume_size': 1}
Apr 02 21:20:57.272037 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] creating volume 'volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:20:57.272938 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:57.343750 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] extra_specs: {} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:20:57.344104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] extra_specs: {} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:20:57.348180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03058e8c-01cc-4550-98a8-757267f87527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.353771 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100b53a2-184b-4601-a01f-13c843580253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:20:57.363712 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Volume volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd (067dd5d4-2cf6-4a88-9bd6-868d6d4158dd): created successfully
Apr 02 21:20:57.368167 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100b53a2-184b-4601-a01f-13c843580253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:20:57.373737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Flow 'volume_create_manager' (937b1aa2-c3f6-43d0-9b6b-21a92f04c0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:20:57.381315 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d89dfd20-7947-471b-88a0-31104a2b5fe1 tempest-GroupSnapshotsV319Test-1132415169 None] Created volume successfully.
Apr 02 21:20:58.383428 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-61f9ef7e-9f2f-411d-8403-5a4eb2cb2f5d tempest-GroupSnapshotsV319Test-1132415169 None] GroupSnapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: creating.
Apr 02 21:20:58.412048 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-61f9ef7e-9f2f-411d-8403-5a4eb2cb2f5d tempest-GroupSnapshotsV319Test-1132415169 None] Group snapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: creating. {{(pid=129783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4076}}
Apr 02 21:20:58.428004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-61f9ef7e-9f2f-411d-8403-5a4eb2cb2f5d tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:20:58.805257 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-61f9ef7e-9f2f-411d-8403-5a4eb2cb2f5d tempest-GroupSnapshotsV319Test-1132415169 None] group_snapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: created successfully
Apr 02 21:20:59.904823 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] group_snapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: deleting
Apr 02 21:20:59.939289 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] group_snapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: deleting {{(pid=129783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4251}}
Apr 02 21:20:59.961859 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:00.805947 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-861196025 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-861196025, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:21:00.806864 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-861196025 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-861196025, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:21:00.821982 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] Created reservations ['a5f2ab55-8043-4726-8994-9ef986413874', '17d81dce-0a04-4b4b-b66a-6e5dba157ce4', '550d694d-44f9-4757-9630-85a8b5137382', '3b2693b7-d385-4360-9dfc-f33a937d6082'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:00.875358 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-340aa670-810f-4e69-8f09-eff08eb7bc0f tempest-GroupSnapshotsV319Test-1132415169 None] group_snapshot 61bb1741-bc50-4e58-8e63-0e7a5ce07234: deleted successfully
Apr 02 21:21:01.380721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:01.448113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:21:01.448773 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Volume volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:21:01.468104 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] deleting rbd volume volume-067dd5d4-2cf6-4a88-9bd6-868d6d4158dd {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:21:01.813197 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Created reservations ['e5e18210-c75c-475a-8e7d-f1dada1d8cdd'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:01.834408 ncdv-master-1 cinder-volume[129783]: WARNING cinder.quota [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-861196025 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-861196025, it is now deprecated. Please use the default quota class for default quota.
Apr 02 21:21:01.850831 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Created reservations ['dcc60e89-e09d-4cdf-a76e-e9d4c93d70ea', '0b2fd43e-a0ca-4ec5-8aba-a6adc6c92520', '698e0154-fd2d-45ae-8b3d-6e4b1963fe53', '97965515-9b73-4346-a9d4-576075e59717'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:01.931356 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:01.963524 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:02.015576 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:21:02.028577 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-bfd85174-7b16-4031-8055-6180ddaa2b55 tempest-GroupSnapshotsV319Test-1132415169 None] Delete group completed successfully.
Apr 02 21:21:07.331984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:21:07.377004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Flow 'volume_create_manager' (847cef05-d2fa-4272-b994-95e509beb13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:07.389830 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b4733-2fe1-428d-9063-02fdbc40ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.408836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91b4733-2fe1-428d-9063-02fdbc40ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-23909513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f919ec1f-1395-43e7-a747-7a17641927e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac77442d74c04f8c905013d6f48a2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:21:07Z,use_quota=True,user_id='436750bc90b34e04975ae373cf20800b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.415471 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb25bb0-5119-489c-b623-a95aa92112b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.420529 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb25bb0-5119-489c-b623-a95aa92112b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.427593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c2ecca-7502-47ff-8c23-1e273d8b120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.433336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c2ecca-7502-47ff-8c23-1e273d8b120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f919ec1f-1395-43e7-a747-7a17641927e5', 'volume_name': 'volume-f919ec1f-1395-43e7-a747-7a17641927e5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.438655 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467f6b9-f94c-428c-8414-d52be4dff80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.443066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6467f6b9-f94c-428c-8414-d52be4dff80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.448346 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1fa86f-8191-4ca7-96ad-23bfef6389ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.449849 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Volume f919ec1f-1395-43e7-a747-7a17641927e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f919ec1f-1395-43e7-a747-7a17641927e5', 'volume_size': 1}
Apr 02 21:21:07.450464 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] creating volume 'volume-f919ec1f-1395-43e7-a747-7a17641927e5' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:21:07.451488 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:07.549069 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:21:07.549674 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:21:07.553739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1fa86f-8191-4ca7-96ad-23bfef6389ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f919ec1f-1395-43e7-a747-7a17641927e5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.559656 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a55a7d-63f5-418b-9c90-32274a7f6e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:07.572594 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Volume volume-f919ec1f-1395-43e7-a747-7a17641927e5 (f919ec1f-1395-43e7-a747-7a17641927e5): created successfully
Apr 02 21:21:07.583442 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a55a7d-63f5-418b-9c90-32274a7f6e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:07.594661 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Flow 'volume_create_manager' (847cef05-d2fa-4272-b994-95e509beb13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:07.609037 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b10caac3-7293-4b7e-b8e9-270fdf5eb73d tempest-SnapshotsActionsTest-1434791218 None] Created volume successfully.
Apr 02 21:21:08.609492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-239dae79-9a5b-4475-9e6e-2007ee75be7d tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:09.617122 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-239dae79-9a5b-4475-9e6e-2007ee75be7d tempest-SnapshotsActionsTest-1434791218 None] Create snapshot completed successfully
Apr 02 21:21:11.259361 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-18b6ea7e-16c2-4285-8e34-113359182581 tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:11.641369 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-18b6ea7e-16c2-4285-8e34-113359182581 tempest-SnapshotsActionsTest-1434791218 None] Create snapshot completed successfully
Apr 02 21:21:12.516175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a5e2650e-58e8-471d-ad3d-a814c2ba2d13 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-bb65de87-7f5e-486e-baa3-371579bd9225-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:12.518880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-a5e2650e-58e8-471d-ad3d-a814c2ba2d13 tempest-SnapshotsActionsTest-1033549323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:13.694881 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-a5e2650e-58e8-471d-ad3d-a814c2ba2d13 tempest-SnapshotsActionsTest-1033549323 None] Created reservations ['0757e537-e647-46ac-9597-1e40ce3e6625', '1dc8aeac-fc11-44e4-b5c2-4ca3c3b52261', '6cf949be-e9e0-4a38-bafc-2d09b1214a23', 'c3c5a3c1-28d0-4ef4-909d-4d6cd68e1a89'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:13.776398 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-a5e2650e-58e8-471d-ad3d-a814c2ba2d13 tempest-SnapshotsActionsTest-1033549323 None] Delete snapshot completed successfully.
Apr 02 21:21:13.792884 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-a5e2650e-58e8-471d-ad3d-a814c2ba2d13 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-bb65de87-7f5e-486e-baa3-371579bd9225-delete_snapshot'" released by "delete_snapshot" :: held 1.275s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:15.027286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c6b8af2f-2d1e-4b25-bd4a-01a0f958f9db tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:15.710575 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c6b8af2f-2d1e-4b25-bd4a-01a0f958f9db tempest-SnapshotsActionsTest-1434791218 None] Create snapshot completed successfully
Apr 02 21:21:16.247555 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-fc472743-59a4-499d-8958-ce4fa8c90e84 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-cd977497-46fe-46ae-8fd6-0dd2f005b05f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:16.251444 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fc472743-59a4-499d-8958-ce4fa8c90e84 tempest-SnapshotsActionsTest-1033549323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:16.733622 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-fc472743-59a4-499d-8958-ce4fa8c90e84 tempest-SnapshotsActionsTest-1033549323 None] Created reservations ['8a6fed10-28f9-42ab-a598-a32fa95c3c7f', '67af34da-3497-4f5a-944c-01ccbc38b908', 'd9eb9b7d-2578-4850-8c25-d0897b4f726f', '2652c3a0-23b8-4e2f-b41b-700405edffa1'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:16.778942 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fc472743-59a4-499d-8958-ce4fa8c90e84 tempest-SnapshotsActionsTest-1033549323 None] Delete snapshot completed successfully.
Apr 02 21:21:16.783822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-fc472743-59a4-499d-8958-ce4fa8c90e84 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-cd977497-46fe-46ae-8fd6-0dd2f005b05f-delete_snapshot'" released by "delete_snapshot" :: held 0.537s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:17.574873 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1cb9eaa4-facd-4f77-b39e-ba932ab653bd tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:18.734431 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1cb9eaa4-facd-4f77-b39e-ba932ab653bd tempest-SnapshotsActionsTest-1434791218 None] Create snapshot completed successfully
Apr 02 21:21:19.808279 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-14b3df41-cc48-4b94-bdbf-50e3e2c1c7a7 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-fb15ebb9-5f26-491b-9a4b-de37f557eba3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:19.810648 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-14b3df41-cc48-4b94-bdbf-50e3e2c1c7a7 tempest-SnapshotsActionsTest-1033549323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:20.743147 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-14b3df41-cc48-4b94-bdbf-50e3e2c1c7a7 tempest-SnapshotsActionsTest-1033549323 None] Created reservations ['d84bf271-3530-4017-b418-d767bb8dc29f', '5ad4f188-f5e3-4530-8b9d-1815a5c098c5', '0d0307f7-c85b-4624-98dc-5615fc43942f', '71e9faa4-52cc-45e2-b411-ef1b9c7eb33a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:20.776798 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-14b3df41-cc48-4b94-bdbf-50e3e2c1c7a7 tempest-SnapshotsActionsTest-1033549323 None] Delete snapshot completed successfully.
Apr 02 21:21:20.781436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-14b3df41-cc48-4b94-bdbf-50e3e2c1c7a7 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-fb15ebb9-5f26-491b-9a4b-de37f557eba3-delete_snapshot'" released by "delete_snapshot" :: held 0.973s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:21.112657 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-01ff3896-b1d6-485c-b3de-ac8a44dabf9b tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:21.775876 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-01ff3896-b1d6-485c-b3de-ac8a44dabf9b tempest-SnapshotsActionsTest-1434791218 None] Create snapshot completed successfully
Apr 02 21:21:22.285445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f4964bf4-93f7-4dd0-8425-eef471de07f5 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-872cd4a5-3cc4-46d9-aa56-f03fa37c58fb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:22.288763 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f4964bf4-93f7-4dd0-8425-eef471de07f5 tempest-SnapshotsActionsTest-1033549323 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:22.774554 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f4964bf4-93f7-4dd0-8425-eef471de07f5 tempest-SnapshotsActionsTest-1033549323 None] Created reservations ['e3a9b26f-165d-472d-a63c-f1e6db93d856', '37ac3a86-5bde-4ee6-b7bd-4e66d78910f8', 'a91504ee-c7a6-48b4-9f4d-ad1b9a7ecdd2', '263a00e7-5aba-45e0-b943-cbee20b459fd'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:22.808352 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f4964bf4-93f7-4dd0-8425-eef471de07f5 tempest-SnapshotsActionsTest-1033549323 None] Delete snapshot completed successfully.
Apr 02 21:21:22.813110 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f4964bf4-93f7-4dd0-8425-eef471de07f5 tempest-SnapshotsActionsTest-1033549323 None] Lock "b'cinder-872cd4a5-3cc4-46d9-aa56-f03fa37c58fb-delete_snapshot'" released by "delete_snapshot" :: held 0.528s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:23.763089 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80f3435b-a5a1-4e09-8fb3-c77c197209f4 tempest-SnapshotsActionsTest-1434791218 None] Lock "b'cinder-c75b8cfc-174c-41ca-86ff-fee41de4b38b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:23.765727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80f3435b-a5a1-4e09-8fb3-c77c197209f4 tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:24.542553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-80f3435b-a5a1-4e09-8fb3-c77c197209f4 tempest-SnapshotsActionsTest-1434791218 None] Created reservations ['47435bf9-483b-405f-87af-31007d83a2d9', '3857e30a-e6a1-4ba5-bbf6-3afddf8ab9cc', '38e37062-b6f4-438b-85a3-02ad9c4bb183', 'efca3b48-b9e4-42f0-b201-09fd31a5ed07'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:24.575090 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-80f3435b-a5a1-4e09-8fb3-c77c197209f4 tempest-SnapshotsActionsTest-1434791218 None] Delete snapshot completed successfully.
Apr 02 21:21:24.579680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80f3435b-a5a1-4e09-8fb3-c77c197209f4 tempest-SnapshotsActionsTest-1434791218 None] Lock "b'cinder-c75b8cfc-174c-41ca-86ff-fee41de4b38b-delete_snapshot'" released by "delete_snapshot" :: held 0.817s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:24.876230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Lock "b'cinder-f919ec1f-1395-43e7-a747-7a17641927e5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:24.917053 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:24.957150 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:21:24.957569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Volume volume-f919ec1f-1395-43e7-a747-7a17641927e5 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:21:24.963400 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] deleting rbd volume volume-f919ec1f-1395-43e7-a747-7a17641927e5 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:21:25.197540 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Created reservations ['45209bc3-b7f2-4ec2-bfa7-abcc775e9a20', '5b262d73-49b5-446c-b29a-9e4912e2dcf7', '8488e6d3-e337-4f6f-8256-65fed09ab7ec', 'bb969cdd-5b17-4447-84ec-b0bedd33de00'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:25.273740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:25.331004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:25.368594 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:21:25.373764 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Deleted volume successfully.
Apr 02 21:21:25.388073 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-adc590a9-fd44-4a62-9f76-0af47ae0be4a tempest-SnapshotsActionsTest-1434791218 None] Lock "b'cinder-f919ec1f-1395-43e7-a747-7a17641927e5-delete_volume'" released by "delete_volume" :: held 0.512s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:29.356649 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:21:29.357491 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:29.391567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:29.456193 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:21:34.916183 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:21:34.954288 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Flow 'volume_create_manager' (e507923d-6afb-47c2-806c-0a966a15ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:34.962992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7881e-d1ce-4eda-b286-c65bd532b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:34.980595 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7881e-d1ce-4eda-b286-c65bd532b10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1732406761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d141a1cb-eb30-44ef-a3b1-035037987c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6d02664cad84408b9cd67f50650bff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:21:35Z,use_quota=True,user_id='6c64e63d775f4224995e5010056d6707',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:34.986591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee80ec2-f121-4127-a742-a3c7f44e91d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:34.991800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee80ec2-f121-4127-a742-a3c7f44e91d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:34.997991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6cc784-3243-40f0-9382-9d8723423a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:35.002405 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce6cc784-3243-40f0-9382-9d8723423a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd141a1cb-eb30-44ef-a3b1-035037987c42', 'volume_name': 'volume-d141a1cb-eb30-44ef-a3b1-035037987c42', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:35.008335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d81f17-a368-4c36-a560-b1d29f1a7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:35.012502 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d81f17-a368-4c36-a560-b1d29f1a7606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:35.017537 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552bd4b1-5aa0-49a0-94ea-6f4335d6b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:35.018847 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Volume d141a1cb-eb30-44ef-a3b1-035037987c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d141a1cb-eb30-44ef-a3b1-035037987c42', 'volume_size': 1}
Apr 02 21:21:35.019396 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] creating volume 'volume-d141a1cb-eb30-44ef-a3b1-035037987c42' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:21:35.020349 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:35.101071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:21:35.101694 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:21:35.105780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552bd4b1-5aa0-49a0-94ea-6f4335d6b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d141a1cb-eb30-44ef-a3b1-035037987c42', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:35.110585 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c181a0b7-4d23-4f8b-aa77-35979f2f370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:35.120615 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Volume volume-d141a1cb-eb30-44ef-a3b1-035037987c42 (d141a1cb-eb30-44ef-a3b1-035037987c42): created successfully
Apr 02 21:21:35.124381 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c181a0b7-4d23-4f8b-aa77-35979f2f370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:35.130836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Flow 'volume_create_manager' (e507923d-6afb-47c2-806c-0a966a15ba50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:35.139594 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c2db2b0d-96c1-47a7-818b-5bfc3d3384bf tempest-AbsoluteLimitsTests-982274486 None] Created volume successfully.
Apr 02 21:21:36.251900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Lock "b'cinder-d141a1cb-eb30-44ef-a3b1-035037987c42-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:36.289392 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:36.340353 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:21:36.340845 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Volume volume-d141a1cb-eb30-44ef-a3b1-035037987c42 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:21:36.347432 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] deleting rbd volume volume-d141a1cb-eb30-44ef-a3b1-035037987c42 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:21:36.569381 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Created reservations ['1aeb8437-f167-43e4-8f6d-a6ea1929a61c', '5d115745-5645-43ab-8c33-35e31c67b5b7', '5ad5f72b-13b1-4915-9d7b-31288a013965', 'd49f61b5-2065-47b8-969a-95e92fd94654'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:36.618601 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:36.648158 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:36.676011 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:21:36.681142 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Deleted volume successfully.
Apr 02 21:21:36.694335 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8082a898-c7e7-475e-8e17-1de17b160810 tempest-AbsoluteLimitsTests-982274486 None] Lock "b'cinder-d141a1cb-eb30-44ef-a3b1-035037987c42-delete_volume'" released by "delete_volume" :: held 0.442s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:40.162947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:21:40.185603 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Flow 'volume_create_manager' (2d906e1e-9522-4214-a669-b4be3e0c4e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:40.193309 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e7e8c8-392a-44ef-8761-d69b17b9fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.209216 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e7e8c8-392a-44ef-8761-d69b17b9fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-580151221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=21d6edfc-fd20-4c00-b973-5a36d4ad26d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23649e6091d43be90cdd8417947c925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:21:40Z,use_quota=True,user_id='1206356d5f4b48c0b647febb3f83d886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.217785 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305a6ee-7d33-49e5-9aaf-b35ee3bf02ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.222591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6305a6ee-7d33-49e5-9aaf-b35ee3bf02ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.228166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15b5707-63a2-4196-8920-9e68dcce7a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.233580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b15b5707-63a2-4196-8920-9e68dcce7a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d6edfc-fd20-4c00-b973-5a36d4ad26d8', 'volume_name': 'volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.239831 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3fee16-deda-48d0-bbfe-bec413045056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.243708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3fee16-deda-48d0-bbfe-bec413045056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.248484 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750094a-0a96-4c85-a0c5-d4a5df0283b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.249738 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Volume 21d6edfc-fd20-4c00-b973-5a36d4ad26d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8', 'volume_size': 1}
Apr 02 21:21:40.250274 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] creating volume 'volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:21:40.251230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:40.352015 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:21:40.353763 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:21:40.358538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c750094a-0a96-4c85-a0c5-d4a5df0283b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.365445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335ed055-d8d2-433e-8027-45faf828aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:21:40.377051 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Volume volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8 (21d6edfc-fd20-4c00-b973-5a36d4ad26d8): created successfully
Apr 02 21:21:40.381186 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335ed055-d8d2-433e-8027-45faf828aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:21:40.386884 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Flow 'volume_create_manager' (2d906e1e-9522-4214-a669-b4be3e0c4e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:21:40.397268 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-23f106cd-37a4-4ef8-9cf7-241b3ef4295a tempest-VolumesDeleteCascade-522044907 None] Created volume successfully.
Apr 02 21:21:41.386959 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-107ee943-924d-462f-8bdb-f90872e11912 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:41.654229 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-107ee943-924d-462f-8bdb-f90872e11912 tempest-VolumesDeleteCascade-522044907 None] Create snapshot completed successfully
Apr 02 21:21:42.590322 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-fc8fac8e-b741-45a1-bcd1-7ecccbe13b6b tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:43.678605 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-fc8fac8e-b741-45a1-bcd1-7ecccbe13b6b tempest-VolumesDeleteCascade-522044907 None] Create snapshot completed successfully
Apr 02 21:21:44.732336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-21d6edfc-fd20-4c00-b973-5a36d4ad26d8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:44.787415 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Performing cascade delete. {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:963}}
Apr 02 21:21:44.808361 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-bc29ca1b-7ff7-44cf-a309-587c277f68ab-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:44.824567 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:45.671768 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Created reservations ['61233408-a45c-4b06-810a-ef4fb342b7f5', 'd6ceda72-dd0d-41d6-ba9e-d9497afe11c2', 'c7389949-1834-4fe4-a487-f5b9cc0e9bf4', '8b2d3ff7-d111-45e1-b188-ad3e16464e7f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:45.709640 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Delete snapshot completed successfully.
Apr 02 21:21:45.714729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-bc29ca1b-7ff7-44cf-a309-587c277f68ab-delete_snapshot'" released by "delete_snapshot" :: held 0.906s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:45.723736 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-ece3a460-09a9-4813-a4e7-43deff9d0a40-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.007s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:21:45.737025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:46.679971 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Created reservations ['e296ea65-49e5-4ea9-af3f-0c40cb65a2a6', 'a517d5dc-6b80-46ae-b4d3-80f02fe8168f', '8c2e5e5a-c7cc-469f-ba8b-677f965a4b8c', '9b420642-688c-488c-8cb1-a7b6d1305ebe'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:46.716338 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Delete snapshot completed successfully.
Apr 02 21:21:46.721297 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-ece3a460-09a9-4813-a4e7-43deff9d0a40-delete_snapshot'" released by "delete_snapshot" :: held 0.998s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:21:46.722020 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Snapshots deleted, issuing volume delete {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:978}}
Apr 02 21:21:46.723015 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:46.773947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:21:46.774591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Volume volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:21:46.782316 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] deleting rbd volume volume-21d6edfc-fd20-4c00-b973-5a36d4ad26d8 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:21:47.033706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Created reservations ['5284ece1-4322-45d3-904e-b7fcf3c3bb76', 'edb33856-d820-4de1-9f7e-eae7e981dc05', '5cccce25-b693-4ac3-8cc4-dcd9480d11d1', '020b49f4-dab5-4c95-b972-661ca69ac3ff'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:21:47.079443 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:47.103817 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:21:47.128359 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:21:47.134081 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Deleted volume successfully.
Apr 02 21:21:47.146419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-c13f4e09-39b2-4b05-9f59-e1b6163bc5b2 tempest-VolumesDeleteCascade-522044907 None] Lock "b'cinder-21d6edfc-fd20-4c00-b973-5a36d4ad26d8-delete_volume'" released by "delete_volume" :: held 2.414s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:22:29.361735 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:22:29.364009 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:22:29.419309 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:22:29.462284 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:23.929167 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:23.948214 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Flow 'volume_create_manager' (30ed8523-0782-4c16-95cd-6ca467e0370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:23.954892 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13800de-e535-4386-9754-0e19efdeabce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:23.972410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13800de-e535-4386-9754-0e19efdeabce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1584951075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8e3ab844-c74a-42f4-9065-ff87b4198b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5e15a125994c2bbe968e70eb1458c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:24Z,use_quota=True,user_id='9f25979ceb3f4af89842abdeb89ca8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:23.979081 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8106a670-6b22-4b9d-9074-1250777d3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:23.987849 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8106a670-6b22-4b9d-9074-1250777d3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:23.993541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7022910-6d4d-40f5-9251-6ba71762d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:23.998475 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7022910-6d4d-40f5-9251-6ba71762d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3ab844-c74a-42f4-9065-ff87b4198b28', 'volume_name': 'volume-8e3ab844-c74a-42f4-9065-ff87b4198b28', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:24.003868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f8f930-6573-4040-8397-db7fea3a35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:24.007923 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f8f930-6573-4040-8397-db7fea3a35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:24.013245 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f31ad8-6d1f-4a15-bc64-c267c5c56faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:24.013983 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume 8e3ab844-c74a-42f4-9065-ff87b4198b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3ab844-c74a-42f4-9065-ff87b4198b28', 'volume_size': 1}
Apr 02 21:23:24.014474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] creating volume 'volume-8e3ab844-c74a-42f4-9065-ff87b4198b28' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:24.015351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:24.072257 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:24.072665 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:24.076324 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f31ad8-6d1f-4a15-bc64-c267c5c56faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3ab844-c74a-42f4-9065-ff87b4198b28', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:24.081080 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c998d93c-6904-432a-a7d2-cc479639d9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:24.092971 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume volume-8e3ab844-c74a-42f4-9065-ff87b4198b28 (8e3ab844-c74a-42f4-9065-ff87b4198b28): created successfully
Apr 02 21:23:24.097562 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c998d93c-6904-432a-a7d2-cc479639d9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:24.103638 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Flow 'volume_create_manager' (30ed8523-0782-4c16-95cd-6ca467e0370b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:24.112794 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f8a546ce-666b-4634-96d7-0c0a15733e4c tempest-VolumeQuotasAdminTestJSON-1327300816 None] Created volume successfully.
Apr 02 21:23:25.083713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Lock "b'cinder-8e3ab844-c74a-42f4-9065-ff87b4198b28-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:25.126767 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:25.219291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:25.219839 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume volume-8e3ab844-c74a-42f4-9065-ff87b4198b28 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:25.227653 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] deleting rbd volume volume-8e3ab844-c74a-42f4-9065-ff87b4198b28 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:25.471406 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Created reservations ['3a95b1a6-60f7-45b9-a101-fc88a4101f09', 'ba4d5655-1902-4636-a0ed-069aba48cc68', '0516b485-bde3-4433-b2fd-7ec15635c047', 'efa40937-13f9-4ad3-a69a-9d60d18ffd63'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:25.517188 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:25.545836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:25.580273 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:25.584684 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Deleted volume successfully.
Apr 02 21:23:25.598067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-86e8f1db-cdf1-4412-8748-580ca697ebae tempest-VolumeQuotasAdminTestJSON-1327300816 None] Lock "b'cinder-8e3ab844-c74a-42f4-9065-ff87b4198b28-delete_volume'" released by "delete_volume" :: held 0.514s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:26.497008 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:26.515792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Flow 'volume_create_manager' (d3b66343-c400-4a22-bb0b-4944a2ae40a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:26.522784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486fb630-6fc4-468e-8e2e-4cb2186a76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.539863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (486fb630-6fc4-468e-8e2e-4cb2186a76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1614630886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=184b7b13-f5aa-4113-9b93-c205bc0706c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5e15a125994c2bbe968e70eb1458c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:26Z,use_quota=True,user_id='9f25979ceb3f4af89842abdeb89ca8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.545620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c5b2d8-d584-42bb-8823-d97ba3c8c8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.550282 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c5b2d8-d584-42bb-8823-d97ba3c8c8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.555387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1739f41-ed12-4f44-b8c3-827c0271c9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.559483 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1739f41-ed12-4f44-b8c3-827c0271c9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184b7b13-f5aa-4113-9b93-c205bc0706c5', 'volume_name': 'volume-184b7b13-f5aa-4113-9b93-c205bc0706c5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.564998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974e57f4-074e-4506-87d3-5a1f593710c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.568957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974e57f4-074e-4506-87d3-5a1f593710c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.573627 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142a32fb-c35c-443e-baf7-70fe2cc1fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.574690 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume 184b7b13-f5aa-4113-9b93-c205bc0706c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184b7b13-f5aa-4113-9b93-c205bc0706c5', 'volume_size': 1}
Apr 02 21:23:26.575077 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] creating volume 'volume-184b7b13-f5aa-4113-9b93-c205bc0706c5' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:26.575867 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:26.632226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:26.632724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:26.636346 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142a32fb-c35c-443e-baf7-70fe2cc1fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184b7b13-f5aa-4113-9b93-c205bc0706c5', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.640946 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a39bed6-61cb-4961-a424-f05b2ae8c49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:26.649718 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Volume volume-184b7b13-f5aa-4113-9b93-c205bc0706c5 (184b7b13-f5aa-4113-9b93-c205bc0706c5): created successfully
Apr 02 21:23:26.653292 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a39bed6-61cb-4961-a424-f05b2ae8c49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:26.658740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Flow 'volume_create_manager' (d3b66343-c400-4a22-bb0b-4944a2ae40a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:26.666417 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-51095437-ce12-49c8-a017-65cde3e1f5cf tempest-VolumeQuotasAdminTestJSON-1327300816 None] Created volume successfully.
Apr 02 21:23:28.090457 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-074c8e9a-ac6b-4ca1-8ad8-d1a0c2005ab4 tempest-VolumeQuotasAdminTestJSON-1704460062 None] Transfer volume completed successfully.
Apr 02 21:23:28.471701 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Lock "b'cinder-184b7b13-f5aa-4113-9b93-c205bc0706c5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:28.513333 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:28.563779 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:28.564550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Volume volume-184b7b13-f5aa-4113-9b93-c205bc0706c5 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:28.570277 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] deleting rbd volume volume-184b7b13-f5aa-4113-9b93-c205bc0706c5 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:28.848700 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Created reservations ['9371fc24-1664-4cde-a2e0-2bdaee898eda', '72186233-319f-4972-a52d-1c7b5683609c', '3e6a1cf8-a3ca-4f9f-ad0d-b3a7ac75f37b', 'a207f5dc-5773-48e2-98d9-ebae61acceb7'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:28.909772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:28.950279 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:28.991144 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:29.002367 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Deleted volume successfully.
Apr 02 21:23:29.017957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-90fafe0e-6fcb-4d9c-a84c-32ce9847c21c tempest-VolumeQuotasAdminTestJSON-837333447 None] Lock "b'cinder-184b7b13-f5aa-4113-9b93-c205bc0706c5-delete_volume'" released by "delete_volume" :: held 0.544s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:29.358593 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:23:29.359387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:29.384170 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:29.432437 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:39.577024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:39.633729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Flow 'volume_create_manager' (a94db009-d5ad-462e-8a9f-16c45c54724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:39.640961 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda9a813-3c26-4892-a96f-de65b726035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.656233 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda9a813-3c26-4892-a96f-de65b726035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-471400304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b949bfbe8a945aa941f82a98c0d1888',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:40Z,use_quota=True,user_id='bd977c83d1154bc69810ac243e07676e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.663551 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e3a5e-83b0-4095-8066-96ab5bc1832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.668493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e3a5e-83b0-4095-8066-96ab5bc1832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.674360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce85b8d-2117-42b3-a356-4fef5fa9cabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.681446 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce85b8d-2117-42b3-a356-4fef5fa9cabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9', 'volume_name': 'volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.686795 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086d7895-b084-4b1d-aeec-b208b0bbdf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.691680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086d7895-b084-4b1d-aeec-b208b0bbdf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.696548 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eb690f-7c74-4a5d-bf18-35b3edacc5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.697852 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Volume 01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9', 'volume_size': 1}
Apr 02 21:23:39.698419 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] creating volume 'volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:39.700610 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:39.794418 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:39.797994 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:39.803410 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eb690f-7c74-4a5d-bf18-35b3edacc5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.808898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba573990-fcb1-45cd-97f3-dbb05206d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:39.822559 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Volume volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9 (01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9): created successfully
Apr 02 21:23:39.828940 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba573990-fcb1-45cd-97f3-dbb05206d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:39.836535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Flow 'volume_create_manager' (a94db009-d5ad-462e-8a9f-16c45c54724e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:39.861215 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cf9c642d-e2bd-42af-b223-967658c734be tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Created volume successfully.
Apr 02 21:23:40.000936 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:40.038753 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Flow 'volume_create_manager' (23ff2dd2-8715-4cac-9036-0d132a3aaf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:40.046852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cef1e7-a751-41d2-9e00-778eba618af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:40.074696 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8cef1e7-a751-41d2-9e00-778eba618af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-742314365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=24873dd9-832b-44d1-bbec-069663ce55ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac7776ae2fb45cfa015c4056f0ab4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:40Z,use_quota=True,user_id='4cb67e8ec9b44d6f89640b4ccabd1987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:40.081942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8c8c1f-729e-4c89-9925-ac7b4cd74cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:40.086453 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8c8c1f-729e-4c89-9925-ac7b4cd74cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:40.101740 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f43caa-7a9a-46b1-8367-410a87284127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:40.201016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f43caa-7a9a-46b1-8367-410a87284127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24873dd9-832b-44d1-bbec-069663ce55ea', 'volume_name': 'volume-24873dd9-832b-44d1-bbec-069663ce55ea', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29558c3d0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:40.210950 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67b040d-1673-4762-852c-9240965f1ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:40.215230 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67b040d-1673-4762-852c-9240965f1ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:40.220816 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886106ad-696a-4826-936f-4a9819de93ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:40.222076 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Volume 24873dd9-832b-44d1-bbec-069663ce55ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24873dd9-832b-44d1-bbec-069663ce55ea', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29558c3d0>}
Apr 02 21:23:40.222642 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Cloning 24873dd9-832b-44d1-bbec-069663ce55ea from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:23:40.235066 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:40.248499 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 23, 40, 241812)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:23:40.249027 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:23:40.250663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:23:40.257339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:40.258496 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:23:40.265165 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 23, 40, 262209)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:23:40.266456 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:23:40.267274 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:23:40.283657 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:40.396480 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] creating snapshot='volume-24873dd9-832b-44d1-bbec-069663ce55ea.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:23:40.832381 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-24873dd9-832b-44d1-bbec-069663ce55ea.clone_snap' to 'volume-24873dd9-832b-44d1-bbec-069663ce55ea' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:23:40.869092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-76543632-3702-43e8-8cd4-486a554e9612 tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:41.051662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:41.053050 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:41.053612 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:41.084575 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:23:41.085728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Marking volume 24873dd9-832b-44d1-bbec-069663ce55ea as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:23:41.096090 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 24873dd9-832b-44d1-bbec-069663ce55ea. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:23:41.096848 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Creating volume glance metadata for volume 24873dd9-832b-44d1-bbec-069663ce55ea backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:23:41.181482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886106ad-696a-4826-936f-4a9819de93ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24873dd9-832b-44d1-bbec-069663ce55ea', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe29558c3d0>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:41.186263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b00e6-c693-463b-96dc-667a1458ab23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:41.195936 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Volume volume-24873dd9-832b-44d1-bbec-069663ce55ea (24873dd9-832b-44d1-bbec-069663ce55ea): created successfully
Apr 02 21:23:41.200707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6b00e6-c693-463b-96dc-667a1458ab23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:41.206488 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Flow 'volume_create_manager' (23ff2dd2-8715-4cac-9036-0d132a3aaf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:41.215405 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-7397b1d8-0883-4e17-a880-8eca285f90e3 tempest-TestVolumeBackupRestore-163528694 None] Created volume successfully.
Apr 02 21:23:41.863218 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-76543632-3702-43e8-8cd4-486a554e9612 tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Create snapshot completed successfully
Apr 02 21:23:42.372098 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-04-02T21:23:42Z,data_timestamp=2022-04-02T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=dc963741-0ed7-4626-92be-bacfe8ce5f2b,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='0ac7776ae2fb45cfa015c4056f0ab4a0',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='4cb67e8ec9b44d6f89640b4ccabd1987',volume_id=24873dd9-832b-44d1-bbec-069663ce55ea)
Apr 02 21:23:42.373105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.backup.rpcapi [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] continue_backup in rpcapi backup_id dc963741-0ed7-4626-92be-bacfe8ce5f2b {{(pid=129783) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Apr 02 21:23:42.490259 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:23:43.134986 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.644s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:23:43.136045 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-24873dd9-832b-44d1-bbec-069663ce55ea', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '24873dd9-832b-44d1-bbec-069663ce55ea', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:23:43.151946 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] Initialize volume connection completed successfully.
Apr 02 21:23:43.188580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-af7d6cca-265f-4416-bd1d-effb3f34ab7c tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Lock "b'cinder-959055d5-b968-483d-a2de-c86ba1c12778-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:43.191030 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-af7d6cca-265f-4416-bd1d-effb3f34ab7c tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:43.933474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-af7d6cca-265f-4416-bd1d-effb3f34ab7c tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Created reservations ['1e1927c9-3eaf-464c-9961-2fc1d4d25fba', '2f327b6d-0e84-47b3-8f9a-edc1a4fd35e7', '8280bc57-be8e-4a19-8dcc-628a617798ee', 'ca9d02a3-17ce-43b3-99a4-2ad7417611c6'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:43.986094 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-af7d6cca-265f-4416-bd1d-effb3f34ab7c tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Delete snapshot completed successfully.
Apr 02 21:23:43.991984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-af7d6cca-265f-4416-bd1d-effb3f34ab7c tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Lock "b'cinder-959055d5-b968-483d-a2de-c86ba1c12778-delete_snapshot'" released by "delete_snapshot" :: held 0.804s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:44.316024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Lock "b'cinder-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:44.423058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:44.898259 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:44.898717 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Volume volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:44.986239 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] deleting rbd volume volume-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:46.641058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Created reservations ['422d0e4d-3851-459b-a3be-b81b9d29b9e3', 'ce6948c8-22b5-4515-8b50-f4d4367232ae', 'f18b995d-bdda-45b0-9006-379f635739b1', '1d89f690-ab02-43f9-8702-9c1aaddfbe09'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:46.683790 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:46.710647 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:46.744297 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:46.749646 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Deleted volume successfully.
Apr 02 21:23:46.760835 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-4c709231-3780-4f05-a26d-bccc5e5cac1e tempest-VolumeSnapshotQuotasNegativeTestJSON-791241222 None] Lock "b'cinder-01f97f53-94b1-44d8-82e6-a3fc3cfdc2f9-delete_volume'" released by "delete_volume" :: held 2.445s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:49.255937 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] Terminate volume connection completed successfully.
Apr 02 21:23:49.280564 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-e1920d7b-ed06-4555-9015-1a277af405ee tempest-TestVolumeBackupRestore-163528694 None] Remove volume export completed successfully.
Apr 02 21:23:49.981658 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:50.003102 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Flow 'volume_create_manager' (4aa7b9de-b5e4-4425-a492-03a358df1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:50.009877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b25b04e-95ab-4d13-8a53-1a41c828b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.025680 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b25b04e-95ab-4d13-8a53-1a41c828b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:50Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_dc963741-0ed7-4626-92be-bacfe8ce5f2b',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3d159ee6-7514-4ca1-803d-49d79bc9076a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ac7776ae2fb45cfa015c4056f0ab4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:50Z,use_quota=True,user_id='4cb67e8ec9b44d6f89640b4ccabd1987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.032013 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa03bf8-7e62-45bc-9a47-483d078b610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.036589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa03bf8-7e62-45bc-9a47-483d078b610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.041897 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd220cc-d0d0-4f6e-9921-080163f80a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.046049 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd220cc-d0d0-4f6e-9921-080163f80a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d159ee6-7514-4ca1-803d-49d79bc9076a', 'volume_name': 'volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.051101 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0330a2-b752-4b07-a322-50410cf2ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.055071 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0330a2-b752-4b07-a322-50410cf2ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.059823 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde2ac62-6977-426d-8d6d-4e150f0b0c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.060941 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Volume 3d159ee6-7514-4ca1-803d-49d79bc9076a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'volume_size': 1}
Apr 02 21:23:50.061361 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] creating volume 'volume-3d159ee6-7514-4ca1-803d-49d79bc9076a' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:50.062191 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:50.127349 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:50.127809 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:50.131667 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde2ac62-6977-426d-8d6d-4e150f0b0c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.136403 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c5ce6-bc4f-4bda-8c83-06be2589d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:50.145493 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Volume volume-3d159ee6-7514-4ca1-803d-49d79bc9076a (3d159ee6-7514-4ca1-803d-49d79bc9076a): created successfully
Apr 02 21:23:50.149129 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c5ce6-bc4f-4bda-8c83-06be2589d371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:50.154545 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Flow 'volume_create_manager' (4aa7b9de-b5e4-4425-a492-03a358df1160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:50.164809 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Created volume successfully.
Apr 02 21:23:51.032122 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:51.051511 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (7459e73b-43ab-41db-b85e-16ad01947e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:51.058506 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a02248-19f1-49b9-a986-47235239c633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.075587 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:23:51.100559 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a02248-19f1-49b9-a986-47235239c633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798804500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4a7b49c2-dd52-4a7c-8d21-d16ca0698de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e439a4f5dae544f0bfe852f45f89c689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:51Z,use_quota=True,user_id='12d297c31444417f80657d3f4ddfef5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.106603 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01cfcbf-d94b-4c49-8347-b0b605147aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.111302 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01cfcbf-d94b-4c49-8347-b0b605147aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.116520 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e7e90a-5f20-448e-af82-1c0ba6b491a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.120852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e7e90a-5f20-448e-af82-1c0ba6b491a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a7b49c2-dd52-4a7c-8d21-d16ca0698de8', 'volume_name': 'volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.126457 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e25e8-9bdb-43d8-9e5c-e949e18b9dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.130618 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3e25e8-9bdb-43d8-9e5c-e949e18b9dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.135464 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f817e-49fc-4f57-a0af-9998795024bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.136680 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Volume 4a7b49c2-dd52-4a7c-8d21-d16ca0698de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8', 'volume_size': 1}
Apr 02 21:23:51.137185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] creating volume 'volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:51.138326 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:51.201758 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:51.202151 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:51.205968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0f817e-49fc-4f57-a0af-9998795024bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.211061 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008cb8d8-05a6-4ae9-a117-6e1736a38f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:51.223059 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8 (4a7b49c2-dd52-4a7c-8d21-d16ca0698de8): created successfully
Apr 02 21:23:51.228535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008cb8d8-05a6-4ae9-a117-6e1736a38f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:51.234201 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (7459e73b-43ab-41db-b85e-16ad01947e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:51.243709 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b618b06f-7d98-4dd3-82ef-469faffbca68 tempest-VolumesListAdminTestJSON-1841194699 None] Created volume successfully.
Apr 02 21:23:51.725899 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.650s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:23:51.726554 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '3d159ee6-7514-4ca1-803d-49d79bc9076a', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:23:51.740482 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Initialize volume connection completed successfully.
Apr 02 21:23:52.594984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:52.615662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (352d5ec1-3090-4484-a814-e5ac9010fcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:52.622588 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d632179-ac50-4065-a41e-462677480b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.644091 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d632179-ac50-4065-a41e-462677480b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-333586127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=11d6de6b-867b-4efb-9571-a35721caf9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e439a4f5dae544f0bfe852f45f89c689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:53Z,use_quota=True,user_id='12d297c31444417f80657d3f4ddfef5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.653704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b597195-d771-4bf3-a23a-a5aee5450bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.659469 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b597195-d771-4bf3-a23a-a5aee5450bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.665553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00ab857-6e73-414e-b9e9-f54ad153630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.670739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f00ab857-6e73-414e-b9e9-f54ad153630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d6de6b-867b-4efb-9571-a35721caf9ff', 'volume_name': 'volume-11d6de6b-867b-4efb-9571-a35721caf9ff', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.676829 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f9f393-0bad-4e37-b6e2-d341bf5bc04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.681338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f9f393-0bad-4e37-b6e2-d341bf5bc04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.691136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462be184-5254-4ab4-8380-1eefa676595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.691136 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Volume 11d6de6b-867b-4efb-9571-a35721caf9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d6de6b-867b-4efb-9571-a35721caf9ff', 'volume_size': 1}
Apr 02 21:23:52.691136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] creating volume 'volume-11d6de6b-867b-4efb-9571-a35721caf9ff' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:52.691136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:52.900918 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:52.901838 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:52.905582 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462be184-5254-4ab4-8380-1eefa676595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d6de6b-867b-4efb-9571-a35721caf9ff', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.910395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87323dc4-047c-4ab4-a071-ddbe01da3f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:52.923505 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-11d6de6b-867b-4efb-9571-a35721caf9ff (11d6de6b-867b-4efb-9571-a35721caf9ff): created successfully
Apr 02 21:23:52.928915 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87323dc4-047c-4ab4-a071-ddbe01da3f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:52.936255 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (352d5ec1-3090-4484-a814-e5ac9010fcd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:52.946166 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8b030e0d-f9a2-4ffe-99d0-8f25b5bb5f2f tempest-VolumesListAdminTestJSON-1841194699 None] Created volume successfully.
Apr 02 21:23:54.142206 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:54.180016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (5db3ebc1-52f6-4537-a3a8-87a6e41c8449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:54.188783 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7bfa61-2c26-4525-a1fc-7dccbe851b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.225832 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7bfa61-2c26-4525-a1fc-7dccbe851b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1026245529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2a0d9f5-4a85-4d05-94c0-63d256b91d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e439a4f5dae544f0bfe852f45f89c689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:54Z,use_quota=True,user_id='12d297c31444417f80657d3f4ddfef5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.231858 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87af80d8-0b5d-43dd-9e03-9a8c62187fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.236898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87af80d8-0b5d-43dd-9e03-9a8c62187fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.242761 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d829737-0ccc-4cde-a6ff-30edf331e32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.247313 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d829737-0ccc-4cde-a6ff-30edf331e32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a0d9f5-4a85-4d05-94c0-63d256b91d58', 'volume_name': 'volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.252591 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f36e65-7bcf-4258-bfc9-1d35aa7921c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.257199 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f36e65-7bcf-4258-bfc9-1d35aa7921c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.262609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf86cb5-c3ca-4108-bf6b-fde457589083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.264079 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Volume a2a0d9f5-4a85-4d05-94c0-63d256b91d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58', 'volume_size': 1}
Apr 02 21:23:54.264707 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] creating volume 'volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:54.266204 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:54.511058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:54.513095 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:54.522807 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf86cb5-c3ca-4108-bf6b-fde457589083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.532033 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea814d5-9698-4a33-b2b7-b0d82c01f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:54.550431 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58 (a2a0d9f5-4a85-4d05-94c0-63d256b91d58): created successfully
Apr 02 21:23:54.557456 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea814d5-9698-4a33-b2b7-b0d82c01f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:54.563672 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Flow 'volume_create_manager' (5db3ebc1-52f6-4537-a3a8-87a6e41c8449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:54.577129 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4c84b8f2-f68a-4fae-af2a-57a5f3679850 tempest-VolumesListAdminTestJSON-1841194699 None] Created volume successfully.
Apr 02 21:23:55.613010 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:23:55.632661 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Flow 'volume_create_manager' (5c0707df-0a38-4f69-925a-785c80fa1d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:55.640935 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e7e00c-1e05-4065-bca2-bae80dc9edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.657484 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e7e00c-1e05-4065-bca2-bae80dc9edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=530b6ba8-5830-4604-9e0c-4978f506d045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1a43dd42a746e297e5fac4ae74236d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:23:56Z,use_quota=True,user_id='d0710ab1e5e84258a206c7fd56e98bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.664043 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fbe2bb-8c6e-4015-b30b-d32831e9d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.668493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fbe2bb-8c6e-4015-b30b-d32831e9d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.673792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903dfb98-86f7-4852-bf3a-4ad92fa04a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.678259 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903dfb98-86f7-4852-bf3a-4ad92fa04a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530b6ba8-5830-4604-9e0c-4978f506d045', 'volume_name': 'volume-530b6ba8-5830-4604-9e0c-4978f506d045', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.683734 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd19ce4-c675-405c-bfe1-50a9537225da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.688760 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd19ce4-c675-405c-bfe1-50a9537225da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.693849 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04628a7-396d-4003-be67-0fc92e7675da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.694912 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Volume 530b6ba8-5830-4604-9e0c-4978f506d045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530b6ba8-5830-4604-9e0c-4978f506d045', 'volume_size': 1}
Apr 02 21:23:55.695301 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] creating volume 'volume-530b6ba8-5830-4604-9e0c-4978f506d045' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:23:55.695965 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:55.753007 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:23:55.753425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:23:55.758873 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04628a7-396d-4003-be67-0fc92e7675da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530b6ba8-5830-4604-9e0c-4978f506d045', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.764520 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008dfc7e-1c07-4ed2-8dc1-d012e5692048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:23:55.775250 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Volume volume-530b6ba8-5830-4604-9e0c-4978f506d045 (530b6ba8-5830-4604-9e0c-4978f506d045): created successfully
Apr 02 21:23:55.779131 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008dfc7e-1c07-4ed2-8dc1-d012e5692048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:23:55.784737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Flow 'volume_create_manager' (5c0707df-0a38-4f69-925a-785c80fa1d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:23:55.793120 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-94a6a9e2-5e88-40eb-94c8-e20991873464 tempest-VolumesListAdminTestJSON-562043463 None] Created volume successfully.
Apr 02 21:23:55.953608 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Terminate volume connection completed successfully.
Apr 02 21:23:55.969065 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-4b060606-044e-4b38-9fe5-b5eed4bd7097 tempest-TestVolumeBackupRestore-163528694 None] Remove volume export completed successfully.
Apr 02 21:23:56.748092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Lock "b'cinder-530b6ba8-5830-4604-9e0c-4978f506d045-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:56.779609 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:56.839291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:56.839766 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Volume volume-530b6ba8-5830-4604-9e0c-4978f506d045 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:56.850424 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] deleting rbd volume volume-530b6ba8-5830-4604-9e0c-4978f506d045 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:56.865739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-a2a0d9f5-4a85-4d05-94c0-63d256b91d58-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:56.900843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:56.952225 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:56.953538 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:56.959687 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] deleting rbd volume volume-a2a0d9f5-4a85-4d05-94c0-63d256b91d58 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:57.136566 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Created reservations ['64384ed1-b4a5-4ac0-85ae-0e3b188a4ea1', '6809366d-932c-41dd-9691-0a7568ce7c30', '63ece2b9-f6d8-4326-b5f1-4ddb8cd44b11', '7c23df29-5019-4f5a-8095-9b41fa1c83b0'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:57.186941 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:57.212053 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:57.236972 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:57.250618 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Deleted volume successfully.
Apr 02 21:23:57.270337 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f776d5e2-2d7c-4efe-8446-c1b237772c1d tempest-VolumesListAdminTestJSON-562043463 None] Lock "b'cinder-530b6ba8-5830-4604-9e0c-4978f506d045-delete_volume'" released by "delete_volume" :: held 0.522s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:57.286072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Created reservations ['39fb6e88-db6f-448f-b0ba-8db1aabbe622', 'fa944521-f805-4d28-9286-f248ef694813', 'd3197047-95dc-4cba-a1e4-76dd4db06286', 'f36af009-c3ef-4863-be1a-20b0b98e3190'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:57.333898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:57.356305 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:57.385925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:57.389831 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Deleted volume successfully.
Apr 02 21:23:57.401724 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f1217f2a-8cc6-4856-b4aa-2b3afdef206f tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-a2a0d9f5-4a85-4d05-94c0-63d256b91d58-delete_volume'" released by "delete_volume" :: held 0.536s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:57.938967 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-11d6de6b-867b-4efb-9571-a35721caf9ff-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:57.980141 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:58.017507 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:58.017860 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-11d6de6b-867b-4efb-9571-a35721caf9ff is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:58.023462 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] deleting rbd volume volume-11d6de6b-867b-4efb-9571-a35721caf9ff {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:58.236319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Created reservations ['2e3da43c-946b-4661-8b87-98e57dc0c622', 'c3a4e1ba-5441-4c1c-9f63-82a8464e0587', '5e86916a-57db-4250-9a74-4239424a78af', '3a83bd4b-5e2a-43c2-82fe-d7e3d8bbb4c8'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:58.278774 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:58.308360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:58.366942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:58.372119 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Deleted volume successfully.
Apr 02 21:23:58.386426 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-8c0cfef2-c4ca-471f-9853-09dcf3780d2d tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-11d6de6b-867b-4efb-9571-a35721caf9ff-delete_volume'" released by "delete_volume" :: held 0.447s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:59.059760 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:23:59.093836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:59.128699 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:23:59.129124 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Volume volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:23:59.133957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] deleting rbd volume volume-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:23:59.358140 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Created reservations ['9462abcd-ce16-4e88-ae2d-e712e5b9f212', 'd7271be9-839d-4551-838a-40e3ad6ddb1f', 'b62b8acb-eb72-45aa-97bd-96ad9507a831', '5f3e7645-374c-4808-bb3f-3a00ae64a535'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:23:59.420821 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:59.494524 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:23:59.538504 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:23:59.543809 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Deleted volume successfully.
Apr 02 21:23:59.564949 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0337f3a1-d2ab-4855-84ab-c0dfa29cac58 tempest-VolumesListAdminTestJSON-1841194699 None] Lock "b'cinder-4a7b49c2-dd52-4a7c-8d21-d16ca0698de8-delete_volume'" released by "delete_volume" :: held 0.505s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:23:59.674037 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-c8038d53-8df2-45d3-b547-5d758e964e88 tempest-TestVolumeBackupRestore-163528694 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:24:00.536431 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-c8038d53-8df2-45d3-b547-5d758e964e88 tempest-TestVolumeBackupRestore-163528694 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.862s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:24:00.537233 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-c8038d53-8df2-45d3-b547-5d758e964e88 tempest-TestVolumeBackupRestore-163528694 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '3d159ee6-7514-4ca1-803d-49d79bc9076a', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:24:00.565711 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-c8038d53-8df2-45d3-b547-5d758e964e88 tempest-TestVolumeBackupRestore-163528694 None] Connection info returned from driver {'name': 'volumes/volume-3d159ee6-7514-4ca1-803d-49d79bc9076a', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3d159ee6-7514-4ca1-803d-49d79bc9076a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '81ae9920-3acc-4c1f-a8b1-51e86d6bfe4c'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:24:00.635488 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-c8038d53-8df2-45d3-b547-5d758e964e88 tempest-TestVolumeBackupRestore-163528694 None] attachment_update completed successfully.
Apr 02 21:24:04.752395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:24:04.772975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Flow 'volume_create_manager' (8bc0adcc-bdac-4957-902d-11d59c4a7b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:24:04.779487 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c507d4-e5fa-4f71-abe7-f8dc31b86ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.794512 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c507d4-e5fa-4f71-abe7-f8dc31b86ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-346089133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae582f0d-b716-4060-9010-f26283de323c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7647e168474a45789031750d07df5429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:24:05Z,use_quota=True,user_id='4ad346194bea43d482ffa0722ca892f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.800404 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62dbb6-588d-4e8c-aad2-c9a626e47ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.804525 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e62dbb6-588d-4e8c-aad2-c9a626e47ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.809621 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa1f570-3b83-4541-a137-c9b41117b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.814387 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa1f570-3b83-4541-a137-c9b41117b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae582f0d-b716-4060-9010-f26283de323c', 'volume_name': 'volume-ae582f0d-b716-4060-9010-f26283de323c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.819302 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864b5b4-808a-4e87-a75d-c627dc50275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.823282 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e864b5b4-808a-4e87-a75d-c627dc50275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.827991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1033f2-0f72-478f-a4ed-150890ed0fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.829081 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Volume ae582f0d-b716-4060-9010-f26283de323c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae582f0d-b716-4060-9010-f26283de323c', 'volume_size': 1}
Apr 02 21:24:04.829479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] creating volume 'volume-ae582f0d-b716-4060-9010-f26283de323c' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:24:04.830472 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:04.881750 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:24:04.882063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:24:04.885787 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1033f2-0f72-478f-a4ed-150890ed0fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae582f0d-b716-4060-9010-f26283de323c', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.890643 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fee1100-4e38-4b4c-bc6c-dee656308649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:24:04.899586 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Volume volume-ae582f0d-b716-4060-9010-f26283de323c (ae582f0d-b716-4060-9010-f26283de323c): created successfully
Apr 02 21:24:04.903254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fee1100-4e38-4b4c-bc6c-dee656308649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:24:04.908900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Flow 'volume_create_manager' (8bc0adcc-bdac-4957-902d-11d59c4a7b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:24:04.916165 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-35b4cc94-4b91-45d4-b6bc-86712643babb tempest-VolumesNegativeTest-699432410 None] Created volume successfully.
Apr 02 21:24:09.688334 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-b19c42b5-82b8-4c96-9103-07147aed5705 tempest-TestVolumeBackupRestore-163528694 None] Terminate volume connection completed successfully.
Apr 02 21:24:09.689975 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-50468890-cfbe-419d-84f9-ce4c1dfcebdf req-b19c42b5-82b8-4c96-9103-07147aed5705 tempest-TestVolumeBackupRestore-163528694 None] Deleting attachment 81ae9920-3acc-4c1f-a8b1-51e86d6bfe4c. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:24:26.034119 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Lock "b'cinder-ae582f0d-b716-4060-9010-f26283de323c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:24:26.072663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:26.112976 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:24:26.113424 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Volume volume-ae582f0d-b716-4060-9010-f26283de323c is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:24:26.118102 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] deleting rbd volume volume-ae582f0d-b716-4060-9010-f26283de323c {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:24:26.306144 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Created reservations ['1cc8b37b-220c-41f6-ba92-0cb68ff5fe13', '7893101f-6b73-4c4a-acb3-161dceeda1a6', '60047ec7-fb82-47f1-8343-7cb8d95ad326', '0f9d3a97-d561-4d73-9778-788cfb69b437'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:24:26.348328 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:26.369492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:26.397772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:24:26.402203 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Deleted volume successfully.
Apr 02 21:24:26.413705 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-841a4fa1-8a6c-49df-9649-3d7f65d5397d tempest-VolumesNegativeTest-699432410 None] Lock "b'cinder-ae582f0d-b716-4060-9010-f26283de323c-delete_volume'" released by "delete_volume" :: held 0.380s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:24:29.358740 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:24:29.359423 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:29.380185 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:24:29.401741 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:25:29.356995 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:25:29.357689 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:25:29.382758 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:25:29.408677 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:26:29.353458 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:26:29.354157 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:26:29.376345 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:26:29.397546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:27:29.352925 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:27:29.353642 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:27:29.374865 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:27:29.396894 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:28:29.351870 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:28:29.352583 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:28:29.373291 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:28:29.395228 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:29:29.350225 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:29:29.350948 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:29:29.371946 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:29:29.394659 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:29:59.522992 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-3d159ee6-7514-4ca1-803d-49d79bc9076a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:29:59.555246 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:00.629942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Volume volume-3d159ee6-7514-4ca1-803d-49d79bc9076a is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:30:00.653277 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] deleting rbd volume volume-3d159ee6-7514-4ca1-803d-49d79bc9076a {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:30:00.673746 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-24873dd9-832b-44d1-bbec-069663ce55ea-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:00.710554 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:01.652695 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] deleting rbd volume volume-24873dd9-832b-44d1-bbec-069663ce55ea {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:30:01.694035 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Created reservations ['eb6761cc-72d1-450d-8798-9f75ddfd66df', '4597a0e6-50d8-4278-96bf-2d94952a624a', '15a905b0-96ba-48d2-93e7-abf3615b735c', '4a6d8071-241d-46f0-b62a-526ad9082c89'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:30:01.740600 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:01.769803 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:01.798566 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:30:01.803935 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Deleted volume successfully.
Apr 02 21:30:01.816723 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-cbf45713-5fa6-4c64-8a87-bc502bc66200 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-3d159ee6-7514-4ca1-803d-49d79bc9076a-delete_volume'" released by "delete_volume" :: held 2.294s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:01.855956 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:30:01.885674 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] deleting parent snapshot volume-24873dd9-832b-44d1-bbec-069663ce55ea.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:30:02.697047 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] Created reservations ['f9f8afcd-cf85-4fba-b06b-920f0d8f1c26', '1fc1a8ec-ac5e-43f2-ab48-6c88d2bd82b8', '3646ac1d-328b-48b4-ab7e-884f0862d858', 'fc6c4709-10f6-4532-ab6c-7f8923299a28'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:30:02.738181 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:02.760573 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:02.782632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:30:02.786727 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] Deleted volume successfully.
Apr 02 21:30:02.797593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-69f69f0b-5fe1-4a11-9f60-5b9f41ef9104 tempest-TestVolumeBackupRestore-163528694 None] Lock "b'cinder-24873dd9-832b-44d1-bbec-069663ce55ea-delete_volume'" released by "delete_volume" :: held 2.124s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:21.412003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:30:21.430957 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (d5fe7d54-5412-4d4c-ba24-38654e0a9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:21.437647 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0687012-55e7-4e6e-9d22-921881027016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:21.453271 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0687012-55e7-4e6e-9d22-921881027016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1115728557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5164747f-be44-4ddb-adff-71e6ec89d263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:30:21Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:21.459420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fefbc4a-7b20-45e1-a57b-f32dafa4b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:21.463716 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fefbc4a-7b20-45e1-a57b-f32dafa4b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:21.468913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cab5bc-29a1-4179-a8bd-924f35f24b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:21.551870 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cab5bc-29a1-4179-a8bd-924f35f24b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5164747f-be44-4ddb-adff-71e6ec89d263', 'volume_name': 'volume-5164747f-be44-4ddb-adff-71e6ec89d263', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952d2520>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:21.557006 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2ec4b-d485-4f87-870b-10018f3d534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:21.561041 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab2ec4b-d485-4f87-870b-10018f3d534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:21.565906 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61d515b-c2b2-4b09-be72-17fff7d1c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:21.567021 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Volume 5164747f-be44-4ddb-adff-71e6ec89d263: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5164747f-be44-4ddb-adff-71e6ec89d263', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952d2520>}
Apr 02 21:30:21.567598 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Cloning 5164747f-be44-4ddb-adff-71e6ec89d263 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:30:21.576528 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:21.586135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 30, 21, 580904)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:30:21.586526 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:30:21.586930 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:30:21.590730 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:21.591598 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:30:21.596772 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 30, 21, 594696)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:30:21.597180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:30:21.597564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:30:21.608153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:21.655547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] creating snapshot='volume-5164747f-be44-4ddb-adff-71e6ec89d263.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:30:22.696055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-5164747f-be44-4ddb-adff-71e6ec89d263.clone_snap' to 'volume-5164747f-be44-4ddb-adff-71e6ec89d263' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:30:22.835985 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:30:22.837162 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:30:22.837541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:30:22.855697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:30:22.856395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Marking volume 5164747f-be44-4ddb-adff-71e6ec89d263 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:30:22.863807 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 5164747f-be44-4ddb-adff-71e6ec89d263. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:30:22.864226 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Creating volume glance metadata for volume 5164747f-be44-4ddb-adff-71e6ec89d263 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:30:22.914660 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61d515b-c2b2-4b09-be72-17fff7d1c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5164747f-be44-4ddb-adff-71e6ec89d263', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952d2520>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:22.919286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da4f8a-e652-4de0-af5a-24726a6043cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:22.927321 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-5164747f-be44-4ddb-adff-71e6ec89d263 (5164747f-be44-4ddb-adff-71e6ec89d263): created successfully
Apr 02 21:30:22.930880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9da4f8a-e652-4de0-af5a-24726a6043cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:22.936382 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (d5fe7d54-5412-4d4c-ba24-38654e0a9086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:22.943920 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-20cbe4e2-6f6a-45fc-89ae-a2bda9915410 tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:30:23.752338 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-98225149-94a2-4410-b10f-fee58fb601d4 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:24.782179 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-98225149-94a2-4410-b10f-fee58fb601d4 tempest-TestVolumeBootPattern-1833101236 None] Create snapshot completed successfully
Apr 02 21:30:28.083581 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:30:28.116105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (9c9bb778-6b0e-4abb-8c6f-2452200e6268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:28.122493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb32d51e-bd03-4142-b061-8a8df00b9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.140674 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb32d51e-bd03-4142-b061-8a8df00b9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:30:28Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c93caaa-edd0-422c-abb5-921dce0cd0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9342a8a0-eb55-4b5d-bcc7-d568064a1279,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:30:28Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.146052 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3169ff85-e391-49ea-b070-cb1f3f33a710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.151340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3169ff85-e391-49ea-b070-cb1f3f33a710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.157776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc25235-0062-4146-8049-9c1fb22b02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.163176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc25235-0062-4146-8049-9c1fb22b02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'volume_name': 'volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'volume_size': 1, 'snapshot_id': '9342a8a0-eb55-4b5d-bcc7-d568064a1279'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.168715 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dc39a6-eeb9-4f39-84e1-aee989cd740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.173176 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dc39a6-eeb9-4f39-84e1-aee989cd740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.178725 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a23486-e9ef-4786-8f14-de24dae4d966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.179822 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Volume 6c93caaa-edd0-422c-abb5-921dce0cd0a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'volume_size': 1, 'snapshot_id': '9342a8a0-eb55-4b5d-bcc7-d568064a1279'}
Apr 02 21:30:28.198406 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] cloning volumes/volume-5164747f-be44-4ddb-adff-71e6ec89d263@snapshot-9342a8a0-eb55-4b5d-bcc7-d568064a1279 to volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1 {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:30:28.199083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:28.272775 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:28.434922 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:30:28.435711 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:30:28.453728 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Marking volume 6c93caaa-edd0-422c-abb5-921dce0cd0a1 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:30:28.458416 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from snapshot 9342a8a0-eb55-4b5d-bcc7-d568064a1279 to 6c93caaa-edd0-422c-abb5-921dce0cd0a1. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Apr 02 21:30:28.495697 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08a23486-e9ef-4786-8f14-de24dae4d966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'volume_size': 1, 'snapshot_id': '9342a8a0-eb55-4b5d-bcc7-d568064a1279'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.500398 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739b5316-8e77-4712-9a4b-3aea893f108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:28.509019 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1 (6c93caaa-edd0-422c-abb5-921dce0cd0a1): created successfully
Apr 02 21:30:28.512726 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (739b5316-8e77-4712-9a4b-3aea893f108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:28.518437 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (9c9bb778-6b0e-4abb-8c6f-2452200e6268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:28.532271 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-babdc3ce-6cf5-41c1-86d1-89b3165f2649 tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:30:29.350170 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:30:29.351014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:29.376558 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:29.403311 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:30:31.414593 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-5d44fd13-e587-4695-b983-ac05f9246423 tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:30:32.037847 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-5d44fd13-e587-4695-b983-ac05f9246423 tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.623s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:30:32.038589 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-5d44fd13-e587-4695-b983-ac05f9246423 tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:30:32.060602 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-5d44fd13-e587-4695-b983-ac05f9246423 tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c93caaa-edd0-422c-abb5-921dce0cd0a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8478b65d-191a-4cac-80f4-dc38151805bc'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:30:32.105191 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8f7c2747-78ea-4eb7-8501-b39df538aa0f req-5d44fd13-e587-4695-b983-ac05f9246423 tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:30:42.216668 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-3561e347-bed7-4278-8e79-eaef49237168 tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:30:42.217260 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-3561e347-bed7-4278-8e79-eaef49237168 tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment 8478b65d-191a-4cac-80f4-dc38151805bc. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:30:42.354765 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-6c93caaa-edd0-422c-abb5-921dce0cd0a1-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:42.394395 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:42.475673 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:30:42.482604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-6c93caaa-edd0-422c-abb5-921dce0cd0a1 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:30:42.675941 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['ec746109-27e2-4545-b00f-3d0f30c0022f', '221254a1-f660-47b5-a4d2-a0c3e343faf8', '78512f5f-1a4f-40cc-bdaf-a01074413fe6', '29a9834e-f1cd-4594-8bb8-6678abe64ef3'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:30:42.719703 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:42.744085 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:42.774974 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:30:42.779188 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:30:42.793974 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-117e795e-2ac4-4bb6-a788-813f0e9f62a9 req-518adf92-1c7e-42d5-aa33-450e6e2ea4da tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-6c93caaa-edd0-422c-abb5-921dce0cd0a1-delete_volume'" released by "delete_volume" :: held 0.439s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:43.584352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1b987e92-76dc-4376-8e15-334e8822fb29 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9342a8a0-eb55-4b5d-bcc7-d568064a1279-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:43.586640 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-1b987e92-76dc-4376-8e15-334e8822fb29 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:43.880034 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-1b987e92-76dc-4376-8e15-334e8822fb29 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['920327f9-fbd5-49d2-bd89-327ec16aded7', 'f3a6eaa6-1864-48b4-9e57-ee6c6a5e3610', 'cf2b6f2b-dcbd-4e1d-94ec-79e77eec36c0', 'bd8141e0-9137-4c0f-a5db-47293f79798f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:30:43.920427 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-1b987e92-76dc-4376-8e15-334e8822fb29 tempest-TestVolumeBootPattern-1833101236 None] Delete snapshot completed successfully.
Apr 02 21:30:43.924909 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-1b987e92-76dc-4376-8e15-334e8822fb29 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9342a8a0-eb55-4b5d-bcc7-d568064a1279-delete_snapshot'" released by "delete_snapshot" :: held 0.341s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:44.684968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-5164747f-be44-4ddb-adff-71e6ec89d263-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:44.714211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:44.776686 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:30:44.782612 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-5164747f-be44-4ddb-adff-71e6ec89d263 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:30:44.945373 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:30:44.974400 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] deleting parent snapshot volume-5164747f-be44-4ddb-adff-71e6ec89d263.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:30:46.003701 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['e63835d1-f721-43c1-a0b8-c8bf15561c61', 'ce2d89c2-9512-42d5-b2ba-d130cb7179cc', '66ab39b8-f37b-458f-86db-48ef49634aab', 'd26ff5af-465d-4cfd-ac20-b4af7abbbd1c'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:30:46.045921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:46.066944 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:46.089737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:30:46.094696 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:30:46.105608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-80e225d6-2013-4e5d-abde-f6e5e6ab66ad tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-5164747f-be44-4ddb-adff-71e6ec89d263-delete_volume'" released by "delete_volume" :: held 1.421s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:47.232800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:30:47.251900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (1c1f30d3-1a50-4722-afce-8dcbc20398db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:47.258800 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc100de6-04be-45fc-9dbd-f76a725d3aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:47.274182 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc100de6-04be-45fc-9dbd-f76a725d3aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-774533114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1ead373a-9c05-40aa-bfaa-a7e5ab689d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:30:47Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:47.279576 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83c92c-94a0-4a52-84f4-81807f7d1b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:47.283900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc83c92c-94a0-4a52-84f4-81807f7d1b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:47.290028 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01501bc7-feca-4270-91ed-99bd0f39d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:47.367666 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01501bc7-feca-4270-91ed-99bd0f39d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'volume_name': 'volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952dc670>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:47.372762 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad04906-a9d1-49bf-bf1f-02f85f6f50e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:47.376743 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad04906-a9d1-49bf-bf1f-02f85f6f50e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:47.381525 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8605e556-c697-4b7a-a545-d532580acf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:47.382638 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Volume 1ead373a-9c05-40aa-bfaa-a7e5ab689d21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952dc670>}
Apr 02 21:30:47.383209 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Cloning 1ead373a-9c05-40aa-bfaa-a7e5ab689d21 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:30:47.390768 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:30:47.400701 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 30, 47, 395406)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:30:47.401141 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:30:47.401547 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:30:47.405442 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:30:47.406340 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:30:47.411606 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 30, 47, 409356)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:30:47.412039 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:30:47.412431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:30:47.423673 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:30:47.474621 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] creating snapshot='volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:30:47.847164 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21.clone_snap' to 'volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:30:47.978473 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:30:47.979688 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:30:47.980064 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:30:47.995016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:30:47.995654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Marking volume 1ead373a-9c05-40aa-bfaa-a7e5ab689d21 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:30:48.003208 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to 1ead373a-9c05-40aa-bfaa-a7e5ab689d21. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:30:48.003626 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Creating volume glance metadata for volume 1ead373a-9c05-40aa-bfaa-a7e5ab689d21 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:30:48.053270 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8605e556-c697-4b7a-a545-d532580acf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe2952dc670>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:48.059734 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50266677-d4f3-4394-8335-dd6d9093a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:30:48.068355 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21 (1ead373a-9c05-40aa-bfaa-a7e5ab689d21): created successfully
Apr 02 21:30:48.072024 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50266677-d4f3-4394-8335-dd6d9093a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:30:48.079776 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (1c1f30d3-1a50-4722-afce-8dcbc20398db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:30:48.089891 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-3d28d575-c952-4493-8918-4dfb8ee63d14 tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:30:50.161300 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-2f1253f1-b7b9-44c6-934c-c3379c920044 req-e5e9cf30-3e6e-456b-b408-8ac969df9dff tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:30:50.800640 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-2f1253f1-b7b9-44c6-934c-c3379c920044 req-e5e9cf30-3e6e-456b-b408-8ac969df9dff tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.639s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:30:50.801388 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-2f1253f1-b7b9-44c6-934c-c3379c920044 req-e5e9cf30-3e6e-456b-b408-8ac969df9dff tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:30:50.823605 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-2f1253f1-b7b9-44c6-934c-c3379c920044 req-e5e9cf30-3e6e-456b-b408-8ac969df9dff tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1ead373a-9c05-40aa-bfaa-a7e5ab689d21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b97e9a88-9088-4403-941e-487809da81c8'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:30:50.877844 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-2f1253f1-b7b9-44c6-934c-c3379c920044 req-e5e9cf30-3e6e-456b-b408-8ac969df9dff tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:31:00.278866 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-79663d51-be38-4177-b1d3-b5cd858f35f9 req-4b9a8da0-8c8d-4d03-b72d-786f0af7cc72 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:01.060159 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-79663d51-be38-4177-b1d3-b5cd858f35f9 req-4b9a8da0-8c8d-4d03-b72d-786f0af7cc72 tempest-TestVolumeBootPattern-1833101236 None] Create snapshot completed successfully
Apr 02 21:31:04.136323 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:31:04.166393 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (ad42b6c9-524e-4907-8c0f-de914471d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:31:04.172971 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aac2a5e-7575-4913-8860-ca907c69ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.188753 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aac2a5e-7575-4913-8860-ca907c69ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:31:04Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a6edf4f9-5a49-40ff-8915-cc99403b56f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fd47783-01ef-4651-a85b-c7d4215f24b8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:31:04Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.194139 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cbf53-0253-4ede-b3e1-01f69908e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.198991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85cbf53-0253-4ede-b3e1-01f69908e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.204098 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e705d-387d-45e1-8372-664647cafff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.208116 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014e705d-387d-45e1-8372-664647cafff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'volume_name': 'volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'volume_size': 1, 'snapshot_id': '9fd47783-01ef-4651-a85b-c7d4215f24b8'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.213633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b6fec2-fbfa-44a3-84ce-ca2c50981b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.217553 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b6fec2-fbfa-44a3-84ce-ca2c50981b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.222352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556bece6-8035-44d1-8f44-321c318b2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.223513 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Volume a6edf4f9-5a49-40ff-8915-cc99403b56f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'volume_size': 1, 'snapshot_id': '9fd47783-01ef-4651-a85b-c7d4215f24b8'}
Apr 02 21:31:04.244943 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] cloning volumes/volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21@snapshot-9fd47783-01ef-4651-a85b-c7d4215f24b8 to volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6 {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:31:04.245629 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:04.342276 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:04.518640 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:31:04.519054 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:31:04.541366 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Marking volume a6edf4f9-5a49-40ff-8915-cc99403b56f6 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:31:04.548329 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from snapshot 9fd47783-01ef-4651-a85b-c7d4215f24b8 to a6edf4f9-5a49-40ff-8915-cc99403b56f6. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Apr 02 21:31:04.583773 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556bece6-8035-44d1-8f44-321c318b2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'volume_size': 1, 'snapshot_id': '9fd47783-01ef-4651-a85b-c7d4215f24b8'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.588615 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4389ef-de89-490d-b511-101e5c651d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:04.597640 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Volume volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6 (a6edf4f9-5a49-40ff-8915-cc99403b56f6): created successfully
Apr 02 21:31:04.601880 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4389ef-de89-490d-b511-101e5c651d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:04.607736 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (ad42b6c9-524e-4907-8c0f-de914471d490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:31:04.621448 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-3296c6e0-32ea-493d-8cc4-b6bfc5ec7dee tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:31:07.461216 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f753f92-171f-4b57-baf9-602d98feda29 req-564a02b3-07db-47db-8564-75ad83328e8a tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:31:08.088907 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-3f753f92-171f-4b57-baf9-602d98feda29 req-564a02b3-07db-47db-8564-75ad83328e8a tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.627s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:31:08.089792 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3f753f92-171f-4b57-baf9-602d98feda29 req-564a02b3-07db-47db-8564-75ad83328e8a tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:31:08.113067 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-564a02b3-07db-47db-8564-75ad83328e8a tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a6edf4f9-5a49-40ff-8915-cc99403b56f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '405a53df-8fdd-467e-85bd-67aa4bf4541a'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:31:08.155655 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3f753f92-171f-4b57-baf9-602d98feda29 req-564a02b3-07db-47db-8564-75ad83328e8a tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:31:18.352798 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-2484aa62-fa5d-4877-9355-194f44b71c06 tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:31:18.354025 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-2484aa62-fa5d-4877-9355-194f44b71c06 tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment 405a53df-8fdd-467e-85bd-67aa4bf4541a. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:31:18.499853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-a6edf4f9-5a49-40ff-8915-cc99403b56f6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:31:18.531900 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:18.612995 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:31:18.619632 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-a6edf4f9-5a49-40ff-8915-cc99403b56f6 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:31:18.824640 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['a9d28a9e-3b37-44b4-91ef-5413e8a9dd77', 'a88fd176-6ca3-4c18-8bd9-16874df5129b', 'da4363aa-afb8-4ff0-8993-e7570173e0c7', 'f5ad5f85-d8e6-4234-93e3-58890a398a98'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:31:18.873012 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:18.899150 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:18.926834 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:31:18.931094 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:31:18.943351 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-ec07a432-93df-4142-9eb0-f3a55c0f00ca req-011d69ca-a357-4008-bc6a-3b91b5133e47 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-a6edf4f9-5a49-40ff-8915-cc99403b56f6-delete_volume'" released by "delete_volume" :: held 0.444s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:31:19.590223 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-05bd97e7-7781-45e5-8c8d-f4ecc9abba03 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9fd47783-01ef-4651-a85b-c7d4215f24b8-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:31:19.592486 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bd97e7-7781-45e5-8c8d-f4ecc9abba03 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:29.349063 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:31:29.350173 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:29.372907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:29.400501 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:31:49.759765 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-05bd97e7-7781-45e5-8c8d-f4ecc9abba03 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['1c290c6e-d481-4c4c-a5a1-c3d1b5c97fc4', 'ff122ef5-edbb-4627-8656-e79a2e7a847d', '527a5389-b548-455f-b637-45d25773a956', 'c4703f53-8b1b-48a9-8447-e38a723c2a96'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:31:49.809069 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-05bd97e7-7781-45e5-8c8d-f4ecc9abba03 tempest-TestVolumeBootPattern-1833101236 None] Delete snapshot completed successfully.
Apr 02 21:31:49.814544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-05bd97e7-7781-45e5-8c8d-f4ecc9abba03 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9fd47783-01ef-4651-a85b-c7d4215f24b8-delete_snapshot'" released by "delete_snapshot" :: held 30.224s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:31:52.836907 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-b305b3ff-f255-424f-aa2a-273cc694a10a tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:31:52.837546 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-b305b3ff-f255-424f-aa2a-273cc694a10a tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment b97e9a88-9088-4403-941e-487809da81c8. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:31:52.972963 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-1ead373a-9c05-40aa-bfaa-a7e5ab689d21-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:31:53.011983 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:53.084057 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:31:53.090651 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:31:53.313645 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:31:53.343713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] deleting parent snapshot volume-1ead373a-9c05-40aa-bfaa-a7e5ab689d21.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:31:53.711444 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['2a487b0d-c7aa-4b61-94c3-bec81b32cb16', '194de342-7c06-45d0-81bb-28c13d485a9b', '326a9a0e-dafc-4ddf-8e83-8b4def96cf53', '760bf4cd-efa4-4c8b-b726-51f39c6d84f0'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:31:53.755004 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:53.777759 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:53.800675 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:31:53.804696 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:31:53.816202 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-3e7e5942-cc53-4e82-b44a-fbda947dafaa req-3cbc00b6-6d43-4614-b429-e2d45743546d tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-1ead373a-9c05-40aa-bfaa-a7e5ab689d21-delete_volume'" released by "delete_volume" :: held 0.843s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:31:56.155796 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:31:56.175324 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (9bc4bd6d-4590-4d92-89cd-5457488d66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:31:56.182732 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307d1575-ebf6-4756-9766-d4c54eb42042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:56.197076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307d1575-ebf6-4756-9766-d4c54eb42042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-960789768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae9ad986-858e-4b1e-97f8-0338ac2a0ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:31:56Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:56.203087 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5274df-e353-4d34-a7a0-acd64523719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:56.207158 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5274df-e353-4d34-a7a0-acd64523719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:56.212232 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ab875-5586-4cc2-a21e-9aaa3b2d8836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:56.289869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ab875-5586-4cc2-a21e-9aaa3b2d8836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'volume_name': 'volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295484b80>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:56.295072 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bd2760-98de-4071-83b5-95c67b002e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:56.299083 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bd2760-98de-4071-83b5-95c67b002e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:56.303814 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47380f7c-3f61-4742-98d2-8a077b8bf7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:56.305013 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Volume ae9ad986-858e-4b1e-97f8-0338ac2a0ffc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295484b80>}
Apr 02 21:31:56.305584 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Cloning ae9ad986-858e-4b1e-97f8-0338ac2a0ffc from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 21:31:56.313708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:31:56.323907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 31, 56, 318307)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:31:56.324441 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:31:56.324869 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 21:31:56.330261 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:31:56.331166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 21:31:56.336531 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 21, 31, 56, 334403)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 21:31:56.336942 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 21:31:56.337336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 21:31:56.348431 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:31:56.396914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] creating snapshot='volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 21:31:57.015945 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc.clone_snap' to 'volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 21:31:57.140535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:31:57.141714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:31:57.142092 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:31:57.159258 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 21:31:57.159872 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Marking volume ae9ad986-858e-4b1e-97f8-0338ac2a0ffc as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:31:57.168914 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to ae9ad986-858e-4b1e-97f8-0338ac2a0ffc. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 21:31:57.169333 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Creating volume glance metadata for volume ae9ad986-858e-4b1e-97f8-0338ac2a0ffc backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 21:31:57.220339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47380f7c-3f61-4742-98d2-8a077b8bf7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295484b80>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:57.224945 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8384c34b-365b-4d40-aaf7-3c606758b2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:31:57.232884 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Volume volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc (ae9ad986-858e-4b1e-97f8-0338ac2a0ffc): created successfully
Apr 02 21:31:57.236444 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8384c34b-365b-4d40-aaf7-3c606758b2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:31:57.241841 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (9bc4bd6d-4590-4d92-89cd-5457488d66ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:31:57.248890 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-66b97bb7-56c9-49cf-ac5d-421bc1b4c644 tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:32:00.377120 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-b41b226b-5070-4d74-b952-441030471063 req-dc2abfeb-a5e5-4df6-95a3-c2eeca4bbab3 tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:32:01.019002 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-b41b226b-5070-4d74-b952-441030471063 req-dc2abfeb-a5e5-4df6-95a3-c2eeca4bbab3 tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.642s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:32:01.019780 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-b41b226b-5070-4d74-b952-441030471063 req-dc2abfeb-a5e5-4df6-95a3-c2eeca4bbab3 tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:32:01.042924 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-b41b226b-5070-4d74-b952-441030471063 req-dc2abfeb-a5e5-4df6-95a3-c2eeca4bbab3 tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b08096eb-71af-4f09-a9d6-b312c8916155'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:32:01.091538 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-b41b226b-5070-4d74-b952-441030471063 req-dc2abfeb-a5e5-4df6-95a3-c2eeca4bbab3 tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:32:29.347946 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:32:29.348821 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:32:29.376564 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:32:29.399440 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:33:29.345216 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:33:29.345924 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:33:29.368326 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:33:29.394115 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:34:22.368269 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-0fef676c-f7f6-419d-a066-5130172f7fa6 req-8edd8266-87f7-4f73-9091-036c1660d866 tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:34:22.369569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-0fef676c-f7f6-419d-a066-5130172f7fa6 req-8edd8266-87f7-4f73-9091-036c1660d866 tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment b08096eb-71af-4f09-a9d6-b312c8916155. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:34:25.076668 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d req-0b856897-98d5-4b75-8539-709d4040ae88 tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:34:25.747655 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d req-0b856897-98d5-4b75-8539-709d4040ae88 tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:34:25.748604 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d req-0b856897-98d5-4b75-8539-709d4040ae88 tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:34:25.771745 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d req-0b856897-98d5-4b75-8539-709d4040ae88 tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ae9ad986-858e-4b1e-97f8-0338ac2a0ffc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca52c484-d14c-47e8-8e30-cf55f722ddf7'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:34:25.818711 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-ebdf21ed-9cff-4b4c-9e86-1305c42db01d req-0b856897-98d5-4b75-8539-709d4040ae88 tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:34:29.349310 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:34:29.350309 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:34:29.374105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:34:29.402877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:35:29.348573 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:35:29.349383 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:35:29.373709 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:35:29.402812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:36:28.515290 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-8ce653f2-3ff3-4c0b-9f27-6cedbd48e103 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:36:28.793502 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-8ce653f2-3ff3-4c0b-9f27-6cedbd48e103 tempest-TestVolumeBootPattern-1833101236 None] Create snapshot completed successfully
Apr 02 21:36:29.348162 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:36:29.348870 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:36:29.371328 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:36:29.393418 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:36:29.908493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:36:29.937809 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (7f103924-1e4c-44b2-8810-f73afce95c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:36:29.944474 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27e3825-afd3-4516-b22d-6f9dd19f3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:29.960445 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27e3825-afd3-4516-b22d-6f9dd19f3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-8975282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e0ec8ec-31b4-49d4-bec3-03a987dba0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d612578d899f4a889190a04840ffa2a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85b1fc57-3396-421d-910f-0c986b0f28cc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:36:30Z,use_quota=True,user_id='9390a098b4d846a2b7dd2dad99d00d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:29.965991 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38859c23-926b-4057-996f-2de8a8c18f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:29.970193 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38859c23-926b-4057-996f-2de8a8c18f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:29.975359 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95097536-f083-46ce-827e-60b438f77176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:29.979492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95097536-f083-46ce-827e-60b438f77176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'volume_name': 'volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'volume_size': 1, 'snapshot_id': '85b1fc57-3396-421d-910f-0c986b0f28cc'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:29.984560 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c2902-950e-4a43-ab98-17ffa9d9006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:29.988425 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c2902-950e-4a43-ab98-17ffa9d9006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:29.993784 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329015f-87e3-4b0f-b0a8-2a8db46c08d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:29.994971 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Volume 6e0ec8ec-31b4-49d4-bec3-03a987dba0ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'volume_size': 1, 'snapshot_id': '85b1fc57-3396-421d-910f-0c986b0f28cc'}
Apr 02 21:36:30.016115 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] cloning volumes/volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc@snapshot-85b1fc57-3396-421d-910f-0c986b0f28cc to volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce {{(pid=129783) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1090}}
Apr 02 21:36:30.016812 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:36:30.078105 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:36:30.200211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:36:30.200541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:36:30.219126 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Marking volume 6e0ec8ec-31b4-49d4-bec3-03a987dba0ce as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 21:36:30.223350 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Copying metadata from snapshot 85b1fc57-3396-421d-910f-0c986b0f28cc to 6e0ec8ec-31b4-49d4-bec3-03a987dba0ce. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:427}}
Apr 02 21:36:30.253852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329015f-87e3-4b0f-b0a8-2a8db46c08d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'volume_size': 1, 'snapshot_id': '85b1fc57-3396-421d-910f-0c986b0f28cc'}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:30.258433 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e26f68-6831-4749-aa0e-2b2b40a5815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:36:30.266657 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Volume volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce (6e0ec8ec-31b4-49d4-bec3-03a987dba0ce): created successfully
Apr 02 21:36:30.270152 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e26f68-6831-4749-aa0e-2b2b40a5815d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:36:30.275624 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Flow 'volume_create_manager' (7f103924-1e4c-44b2-8810-f73afce95c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:36:30.286935 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-d3f482b2-ada7-4504-97d3-10df60abfbaa tempest-TestVolumeBootPattern-1833101236 None] Created volume successfully.
Apr 02 21:36:32.947695 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-118f2c7e-ba37-4c63-8735-f53041295f53 req-d9f54d98-4766-46c0-b70e-7d597de2ce55 tempest-TestVolumeBootPattern-1833101236 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:36:33.618036 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-118f2c7e-ba37-4c63-8735-f53041295f53 req-d9f54d98-4766-46c0-b70e-7d597de2ce55 tempest-TestVolumeBootPattern-1833101236 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.670s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:36:33.618891 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-118f2c7e-ba37-4c63-8735-f53041295f53 req-d9f54d98-4766-46c0-b70e-7d597de2ce55 tempest-TestVolumeBootPattern-1833101236 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:36:33.646050 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-118f2c7e-ba37-4c63-8735-f53041295f53 req-d9f54d98-4766-46c0-b70e-7d597de2ce55 tempest-TestVolumeBootPattern-1833101236 None] Connection info returned from driver {'name': 'volumes/volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6e0ec8ec-31b4-49d4-bec3-03a987dba0ce', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '479460ce-5190-4c30-b6e3-e8e48d9b3d1c'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:36:33.693254 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-118f2c7e-ba37-4c63-8735-f53041295f53 req-d9f54d98-4766-46c0-b70e-7d597de2ce55 tempest-TestVolumeBootPattern-1833101236 None] attachment_update completed successfully.
Apr 02 21:37:29.348403 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:37:29.349298 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:37:29.372708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:37:29.395106 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:38:29.350723 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:38:29.351416 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:38:29.373572 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:38:29.397574 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:38:41.426982 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf req-b6d2ff78-04ab-442c-8a59-c7c63b0102eb tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:38:41.427682 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-99289446-bfb2-4b48-ab9d-6eeb0b6463bf req-b6d2ff78-04ab-442c-8a59-c7c63b0102eb tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment 479460ce-5190-4c30-b6e3-e8e48d9b3d1c. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:38:42.395397 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:38:42.426437 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:38:42.504617 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:38:42.512579 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:38:42.756058 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['3017e6f7-7527-4c1b-b6cc-e068b15d79cd', 'ff7372dd-8a0c-4076-8365-a955878102ec', '2d639e71-0588-4329-910c-1319bca53287', '8c983670-efa9-421c-ad4f-ea975cb35279'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:38:42.797581 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:38:42.819758 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:38:42.842805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:38:42.847129 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:38:42.857955 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-05bcc60f-4b55-4c8d-8a2c-1e24d4f62ec4 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-6e0ec8ec-31b4-49d4-bec3-03a987dba0ce-delete_volume'" released by "delete_volume" :: held 0.463s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:38:43.517641 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0258d71e-1af2-402d-a0af-66f7d8860571 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-85b1fc57-3396-421d-910f-0c986b0f28cc-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:38:43.519339 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-0258d71e-1af2-402d-a0af-66f7d8860571 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:13.680306 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-0258d71e-1af2-402d-a0af-66f7d8860571 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['d902ed89-94d4-467d-8e09-2bf38551688e', '38cedeae-2697-42a5-a51b-536c7ccc8881', 'ae5319af-5744-4d08-bb1a-cdd00878d01e', 'd245e1df-6727-49c3-9e9d-729c001d8d0a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:39:13.716442 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-0258d71e-1af2-402d-a0af-66f7d8860571 tempest-TestVolumeBootPattern-1833101236 None] Delete snapshot completed successfully.
Apr 02 21:39:13.720951 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-0258d71e-1af2-402d-a0af-66f7d8860571 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-85b1fc57-3396-421d-910f-0c986b0f28cc-delete_snapshot'" released by "delete_snapshot" :: held 30.203s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:39:17.611080 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-cd218ebe-76d4-4772-8e20-e586983bca2d req-cbceee7d-0ed5-4dee-ac63-04e02c2b6ee3 tempest-TestVolumeBootPattern-1833101236 None] Terminate volume connection completed successfully.
Apr 02 21:39:17.611714 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-cd218ebe-76d4-4772-8e20-e586983bca2d req-cbceee7d-0ed5-4dee-ac63-04e02c2b6ee3 tempest-TestVolumeBootPattern-1833101236 None] Deleting attachment ca52c484-d14c-47e8-8e30-cf55f722ddf7. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:39:19.351166 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:39:19.382135 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:19.446713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:39:19.453789 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] deleting rbd volume volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:39:19.675741 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 21:39:19.704238 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] deleting parent snapshot volume-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 21:39:20.817319 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] Created reservations ['c1f9934b-16e6-48d0-8020-c338971f4a12', '73872dc6-c960-4a31-b7d7-59304af82783', '4ff3618f-a2d3-48bf-b562-ee4ae79886b4', '34240eae-41f7-438d-b514-97896d928e5f'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:39:20.858593 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:20.885921 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:20.909344 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:39:20.913441 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] Deleted volume successfully.
Apr 02 21:39:20.925296 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-f44e9c5e-3a64-41da-955a-e45362eda1c8 tempest-TestVolumeBootPattern-1833101236 None] Lock "b'cinder-ae9ad986-858e-4b1e-97f8-0338ac2a0ffc-delete_volume'" released by "delete_volume" :: held 1.574s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:39:29.354286 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:39:29.354286 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:29.388158 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:39:29.419984 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:41:29.358200 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:41:29.358881 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:41:29.381614 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:41:29.403877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:42:29.359881 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:42:29.360617 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:42:29.392663 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:42:29.440206 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:43:29.356475 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:43:29.357237 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:43:29.381473 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:43:29.407586 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:44:29.352739 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:44:29.353436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:44:29.375498 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:44:29.396805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:45:29.351751 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:45:29.352487 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:45:29.373666 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:45:29.397247 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:45:32.439877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:45:32.460777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Flow 'volume_create_manager' (2371685b-e287-4b77-ab00-d00e2387abdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:45:32.467819 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f98e3c5-da50-4c3c-aa4b-135aeac6d757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.482875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f98e3c5-da50-4c3c-aa4b-135aeac6d757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1738800317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=99b608a4-f34f-42bf-9e5b-3ef941ad84f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f212cc8d96745d2aa089c88769ffc87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:45:32Z,use_quota=True,user_id='baf3a527e28d43388872b4dba718d940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.488710 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d47e0f4-b128-45f0-81c8-3c3dd3f31388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.492898 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d47e0f4-b128-45f0-81c8-3c3dd3f31388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.498247 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e583032-151b-42bf-8ea1-94c94017b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.502912 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e583032-151b-42bf-8ea1-94c94017b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'volume_name': 'volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.507907 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbe5495-39ca-4a75-9ec5-c77edacd3335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.511852 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbe5495-39ca-4a75-9ec5-c77edacd3335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.516777 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3a5cf6-dbff-4eb5-986e-3b4929d2726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.518437 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Volume 99b608a4-f34f-42bf-9e5b-3ef941ad84f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'volume_size': 1}
Apr 02 21:45:32.518838 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] creating volume 'volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:45:32.519633 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:45:32.590835 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:45:32.591211 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:45:32.595411 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be3a5cf6-dbff-4eb5-986e-3b4929d2726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.600080 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68814ddf-d4e6-4667-b531-62102d3416a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:45:32.608768 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Volume volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6 (99b608a4-f34f-42bf-9e5b-3ef941ad84f6): created successfully
Apr 02 21:45:32.612436 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68814ddf-d4e6-4667-b531-62102d3416a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:45:32.621031 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Flow 'volume_create_manager' (2371685b-e287-4b77-ab00-d00e2387abdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:45:32.630916 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-b989c328-b97c-4a7a-8c6e-15acc8a87835 tempest-ServerActionsTestJSON-1728208507 None] Created volume successfully.
Apr 02 21:45:33.992430 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 req-8d1c3628-814f-4e78-83dd-e5d8dd785eb6 tempest-ServerActionsTestJSON-1728208507 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:45:34.639497 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 req-8d1c3628-814f-4e78-83dd-e5d8dd785eb6 tempest-ServerActionsTestJSON-1728208507 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:45:34.640360 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 req-8d1c3628-814f-4e78-83dd-e5d8dd785eb6 tempest-ServerActionsTestJSON-1728208507 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:45:34.662993 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 req-8d1c3628-814f-4e78-83dd-e5d8dd785eb6 tempest-ServerActionsTestJSON-1728208507 None] Connection info returned from driver {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '88e742af-81ee-472e-bed3-ebbb0a0995fa'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:45:34.707407 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-8ea6acf9-fbdc-49fa-9f7b-323a399f6f60 req-8d1c3628-814f-4e78-83dd-e5d8dd785eb6 tempest-ServerActionsTestJSON-1728208507 None] attachment_update completed successfully.
Apr 02 21:46:00.542152 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-eaec7ee1-c249-4584-8762-37d4f6dbebe9 tempest-ServerActionsTestJSON-1728208507 None] Terminate volume connection completed successfully.
Apr 02 21:46:00.542877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-eaec7ee1-c249-4584-8762-37d4f6dbebe9 tempest-ServerActionsTestJSON-1728208507 None] Deleting attachment 88e742af-81ee-472e-bed3-ebbb0a0995fa. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:46:01.624203 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-1df300c9-9984-4a73-9bfe-d44f055caa6b tempest-ServerActionsTestJSON-1728208507 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:46:02.253510 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-1df300c9-9984-4a73-9bfe-d44f055caa6b tempest-ServerActionsTestJSON-1728208507 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.629s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:46:02.254264 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-1df300c9-9984-4a73-9bfe-d44f055caa6b tempest-ServerActionsTestJSON-1728208507 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:46:02.275807 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-1df300c9-9984-4a73-9bfe-d44f055caa6b tempest-ServerActionsTestJSON-1728208507 None] Connection info returned from driver {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '80249150-57cb-467a-bf8f-e32591b4412c'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:46:02.319811 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-bfee91c2-3a5d-4d5e-bc5f-e79e10db4949 req-1df300c9-9984-4a73-9bfe-d44f055caa6b tempest-ServerActionsTestJSON-1728208507 None] attachment_update completed successfully.
Apr 02 21:46:08.568608 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-baf4f74a-e346-4ae3-911f-bb43027232e8 tempest-ServerActionsTestJSON-1728208507 None] Terminate volume connection completed successfully.
Apr 02 21:46:08.569237 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-baf4f74a-e346-4ae3-911f-bb43027232e8 tempest-ServerActionsTestJSON-1728208507 None] Deleting attachment 80249150-57cb-467a-bf8f-e32591b4412c. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:46:10.095069 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-b09b0d37-f6d1-4862-94c6-2668e6883ddc tempest-ServerActionsTestJSON-1728208507 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:46:10.738653 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-b09b0d37-f6d1-4862-94c6-2668e6883ddc tempest-ServerActionsTestJSON-1728208507 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:46:10.739522 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-b09b0d37-f6d1-4862-94c6-2668e6883ddc tempest-ServerActionsTestJSON-1728208507 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:46:10.763063 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-b09b0d37-f6d1-4862-94c6-2668e6883ddc tempest-ServerActionsTestJSON-1728208507 None] Connection info returned from driver {'name': 'volumes/volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '99b608a4-f34f-42bf-9e5b-3ef941ad84f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a8bde2de-b2fe-4b04-9991-d3c33110fdea'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:46:10.811467 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-71ec48e5-fb2e-412c-8f43-75b3e50594b8 req-b09b0d37-f6d1-4862-94c6-2668e6883ddc tempest-ServerActionsTestJSON-1728208507 None] attachment_update completed successfully.
Apr 02 21:46:18.042026 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-01d4fe36-9eca-4e5a-9501-299c443bb645 req-178d19ea-2e30-4828-92cc-ca5ee74fb03b tempest-ServerActionsTestJSON-1728208507 None] Terminate volume connection completed successfully.
Apr 02 21:46:18.042736 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-01d4fe36-9eca-4e5a-9501-299c443bb645 req-178d19ea-2e30-4828-92cc-ca5ee74fb03b tempest-ServerActionsTestJSON-1728208507 None] Deleting attachment a8bde2de-b2fe-4b04-9991-d3c33110fdea. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:46:19.874926 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Lock "b'cinder-99b608a4-f34f-42bf-9e5b-3ef941ad84f6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:46:19.905269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:46:19.948137 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:46:19.948648 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Volume volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:46:19.953382 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] deleting rbd volume volume-99b608a4-f34f-42bf-9e5b-3ef941ad84f6 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:46:20.149420 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Created reservations ['3d7f6ef0-8783-48d3-a6c6-4388dc9ad0cd', 'd7487092-557a-4c1e-96bf-6a78c90b08de', 'b3ec6866-ad9c-482c-9dee-76310b9008c4', '055b3312-8b84-44a5-a716-8e11d9979c83'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:46:20.190853 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:46:20.213739 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:46:20.237156 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:46:20.241348 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Deleted volume successfully.
Apr 02 21:46:20.253094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-68b1eb85-1dcb-45c0-a9b5-c9af3e88c864 tempest-ServerActionsTestJSON-1728208507 None] Lock "b'cinder-99b608a4-f34f-42bf-9e5b-3ef941ad84f6-delete_volume'" released by "delete_volume" :: held 0.378s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:46:29.353867 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:46:29.354571 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:46:29.377704 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:46:29.405263 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:47:29.350895 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:47:29.352003 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:47:29.390662 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:47:29.448127 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:47:54.679620 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 21:47:54.700014 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Flow 'volume_create_manager' (790ba7b3-88fd-4f3d-a8b3-f250e122a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:47:54.706638 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7493d2-efc0-4e15-adb8-7e0913262a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.721729 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7493d2-efc0-4e15-adb8-7e0913262a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T21:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1728881200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cdf91a12-e487-47a4-9291-8de27fb20027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd583fa9f14e418e850937a746252b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T21:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T21:47:55Z,use_quota=True,user_id='724e735d54f244ab9c2fef0c55a185bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.727175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb713fa-5b9f-46f2-a332-5216a84bd664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.731304 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb713fa-5b9f-46f2-a332-5216a84bd664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.737078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d59327-ba9c-4caa-a3d9-ce671078cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.741172 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d59327-ba9c-4caa-a3d9-ce671078cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf91a12-e487-47a4-9291-8de27fb20027', 'volume_name': 'volume-cdf91a12-e487-47a4-9291-8de27fb20027', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.746120 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd5913f-72b4-4fd7-ab65-8cdd0f0a7d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.750050 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd5913f-72b4-4fd7-ab65-8cdd0f0a7d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.755322 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f20975f-ab95-4e10-86b1-b3bc9e2b9e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.756376 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Volume cdf91a12-e487-47a4-9291-8de27fb20027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf91a12-e487-47a4-9291-8de27fb20027', 'volume_size': 1}
Apr 02 21:47:54.756863 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] creating volume 'volume-cdf91a12-e487-47a4-9291-8de27fb20027' {{(pid=129783) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1036}}
Apr 02 21:47:54.757636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:47:54.808330 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 21:47:54.808737 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 21:47:54.812423 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f20975f-ab95-4e10-86b1-b3bc9e2b9e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf91a12-e487-47a4-9291-8de27fb20027', 'volume_size': 1}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.816994 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca9f9d0-07ee-4d92-966e-cf5760e623a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 21:47:54.825613 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Volume volume-cdf91a12-e487-47a4-9291-8de27fb20027 (cdf91a12-e487-47a4-9291-8de27fb20027): created successfully
Apr 02 21:47:54.829165 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca9f9d0-07ee-4d92-966e-cf5760e623a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 21:47:54.834492 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Flow 'volume_create_manager' (790ba7b3-88fd-4f3d-a8b3-f250e122a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 21:47:54.841826 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-59b5ead0-d2a6-4e7d-80e2-4d413b85b2f5 tempest-TestMinimumBasicScenario-546088523 None] Created volume successfully.
Apr 02 21:47:56.250273 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-56e90d89-a14a-46a3-9e9c-901dde6d40dc req-3e104f1c-21d8-447c-999a-28bd32bdc52e tempest-TestMinimumBasicScenario-546088523 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 21:47:56.950066 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-56e90d89-a14a-46a3-9e9c-901dde6d40dc req-3e104f1c-21d8-447c-999a-28bd32bdc52e tempest-TestMinimumBasicScenario-546088523 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.699s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 21:47:56.950877 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-56e90d89-a14a-46a3-9e9c-901dde6d40dc req-3e104f1c-21d8-447c-999a-28bd32bdc52e tempest-TestMinimumBasicScenario-546088523 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cdf91a12-e487-47a4-9291-8de27fb20027', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'cdf91a12-e487-47a4-9291-8de27fb20027', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 21:47:56.973721 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-56e90d89-a14a-46a3-9e9c-901dde6d40dc req-3e104f1c-21d8-447c-999a-28bd32bdc52e tempest-TestMinimumBasicScenario-546088523 None] Connection info returned from driver {'name': 'volumes/volume-cdf91a12-e487-47a4-9291-8de27fb20027', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cdf91a12-e487-47a4-9291-8de27fb20027', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '16d2ac9c-77f2-45dc-8b23-674bb7433113'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 21:47:57.016921 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-56e90d89-a14a-46a3-9e9c-901dde6d40dc req-3e104f1c-21d8-447c-999a-28bd32bdc52e tempest-TestMinimumBasicScenario-546088523 None] attachment_update completed successfully.
Apr 02 21:48:29.348864 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:48:29.350194 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:48:29.375552 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:48:29.403655 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:49:16.510644 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-bc0d4b3b-0691-416f-860c-e2f34acf542a req-2a530295-56f2-4bf2-9d87-bf740867797a tempest-TestMinimumBasicScenario-546088523 None] Terminate volume connection completed successfully.
Apr 02 21:49:16.511825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-bc0d4b3b-0691-416f-860c-e2f34acf542a req-2a530295-56f2-4bf2-9d87-bf740867797a tempest-TestMinimumBasicScenario-546088523 None] Deleting attachment 16d2ac9c-77f2-45dc-8b23-674bb7433113. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 21:49:17.052302 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Lock "b'cinder-cdf91a12-e487-47a4-9291-8de27fb20027-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 21:49:17.084409 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:49:17.124383 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 21:49:17.124871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Volume volume-cdf91a12-e487-47a4-9291-8de27fb20027 is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 21:49:17.130441 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] deleting rbd volume volume-cdf91a12-e487-47a4-9291-8de27fb20027 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 21:49:17.326269 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Created reservations ['7ca9b128-e54a-40fb-b670-3a389f5ff434', '2f10c8fd-26f3-4fec-b73e-a5af7eb083f0', 'c99170b3-c77a-49d4-b8f7-9a5365f3c205', 'afdb9e14-fbd1-48ed-b856-9b64480f0499'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 21:49:17.366056 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:49:17.387682 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:49:17.410925 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:49:17.415444 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Deleted volume successfully.
Apr 02 21:49:17.427078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-584f86d3-6634-4485-b709-7b086ece2c08 tempest-TestMinimumBasicScenario-546088523 None] Lock "b'cinder-cdf91a12-e487-47a4-9291-8de27fb20027-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 21:49:29.349062 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:49:29.349819 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:49:29.372861 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:49:29.400871 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:50:29.345892 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:50:29.346636 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:50:29.369001 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:50:29.390822 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:51:29.346899 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:51:29.347568 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:51:29.369091 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:51:29.389920 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:52:29.345767 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:52:29.347065 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:52:29.406702 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:52:29.462463 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:53:29.348154 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:53:29.348868 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:53:29.370308 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:53:29.391512 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:54:29.347295 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:54:29.348817 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:54:29.383686 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:54:29.421581 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:55:29.351842 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:55:29.352535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:55:29.372875 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:55:29.395016 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:56:29.351586 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:56:29.352300 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:56:29.374402 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:56:29.395580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:57:29.350570 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:57:29.352150 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:57:29.382528 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:57:29.428074 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:58:29.355835 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:58:29.356488 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:58:29.378816 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:58:29.400708 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 21:59:29.355891 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 21:59:29.356535 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:59:29.377901 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 21:59:29.400178 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:00:29.355430 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:00:29.356094 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:00:29.387070 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:00:29.408834 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:01:29.354820 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:01:29.355437 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:01:29.376180 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:01:29.398272 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:01:39.140572 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}}
Apr 02 22:01:39.160823 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Flow 'volume_create_manager' (216bcbf5-bfd4-4b01-8ab9-f25d538e9622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 22:01:39.167859 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c13e444-602b-44cf-89d6-20ebd5e290af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:39.182493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c13e444-602b-44cf-89d6-20ebd5e290af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-04-02T22:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1887758908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8432b20-c21d-485c-b932-14a2746f4034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e33cf82705649d680da9a6bb1ecf1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-04-02T22:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-04-02T22:01:39Z,use_quota=True,user_id='d67b2d6324ec46ca91756e3a19dac4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4947600b-20cc-4146-8cbc-2a307b7d9583),volume_type_id=4947600b-20cc-4146-8cbc-2a307b7d9583)' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:39.187911 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9312af-d024-436d-83b2-10064800f846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:39.192580 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9312af-d024-436d-83b2-10064800f846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:39.197727 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab29ea4f-fa58-4e7c-9db3-4f95f3c4a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:39.275768 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab29ea4f-fa58-4e7c-9db3-4f95f3c4a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8432b20-c21d-485c-b932-14a2746f4034', 'volume_name': 'volume-a8432b20-c21d-485c-b932-14a2746f4034', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295324b20>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:39.281344 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df297a82-23be-4a94-8e40-f401664eaa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:39.285314 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df297a82-23be-4a94-8e40-f401664eaa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:39.289968 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e01d15e-e262-4da2-825d-c2dbd0ca2a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:39.291589 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Volume a8432b20-c21d-485c-b932-14a2746f4034: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8432b20-c21d-485c-b932-14a2746f4034', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295324b20>}
Apr 02 22:01:39.292162 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Cloning a8432b20-c21d-485c-b932-14a2746f4034 from image 9e007d99-9b87-492c-9398-c1bd6aff27cb  at location (None, None). {{(pid=129783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1051}}
Apr 02 22:01:39.300278 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 22:01:39.311235 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 22, 1, 39, 306146)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 22:01:39.311713 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 22:01:39.312164 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Found cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:874}}
Apr 02 22:01:39.325055 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Lock "b'cinder-9e007d99-9b87-492c-9398-c1bd6aff27cb'" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 22:01:39.325979 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Attempting to retrieve cache entry for image = 9e007d99-9b87-492c-9398-c1bd6aff27cb on host ncdv-master-1@ceph#ceph. {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:815}}
Apr 02 22:01:39.331306 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Found image-volume cache entry: {'id': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'volume_id': '12737775-b8e0-4a5b-9746-c7d74b8b3bfb', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10), 'last_used': datetime.datetime(2022, 4, 2, 22, 1, 39, 329164)}. {{(pid=129783) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Apr 02 22:01:39.332321 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.image.cache [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Image-volume cache entry image_update_at = 2022-04-02 20:43:10+00:00, requested image updated_at = 2022-04-02 20:43:10+00:00. {{(pid=129783) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Apr 02 22:01:39.332825 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Creating from source image-volume 12737775-b8e0-4a5b-9746-c7d74b8b3bfb {{(pid=129783) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:829}}
Apr 02 22:01:39.343506 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:01:39.413378 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] creating snapshot='volume-a8432b20-c21d-485c-b932-14a2746f4034.clone_snap' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:776}}
Apr 02 22:01:40.133113 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] cloning 'volume-12737775-b8e0-4a5b-9746-c7d74b8b3bfb@volume-a8432b20-c21d-485c-b932-14a2746f4034.clone_snap' to 'volume-a8432b20-c21d-485c-b932-14a2746f4034' {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:782}}
Apr 02 22:01:40.271579 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Volume volume-2dc66bc6-7365-4044-a99a-86eb8a66d8c3.deleted is not a clone. {{(pid=129783) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1195}}
Apr 02 22:01:40.272649 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:911}}
Apr 02 22:01:40.273035 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129783) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:920}}
Apr 02 22:01:40.291175 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] clone created successfully {{(pid=129783) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:854}}
Apr 02 22:01:40.291797 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.volume_utils [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Marking volume a8432b20-c21d-485c-b932-14a2746f4034 as bootable. {{(pid=129783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1128}}
Apr 02 22:01:40.299078 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Copying metadata from image 9e007d99-9b87-492c-9398-c1bd6aff27cb to a8432b20-c21d-485c-b932-14a2746f4034. {{(pid=129783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:448}}
Apr 02 22:01:40.299510 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Creating volume glance metadata for volume a8432b20-c21d-485c-b932-14a2746f4034 backed by image 9e007d99-9b87-492c-9398-c1bd6aff27cb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:671}}
Apr 02 22:01:40.349866 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e01d15e-e262-4da2-825d-c2dbd0ca2a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8432b20-c21d-485c-b932-14a2746f4034', 'volume_size': 1, 'image_id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa034640396047d6b05aa8a8842d2e67', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '9e007d99-9b87-492c-9398-c1bd6aff27cb', 'created_at': datetime.datetime(2022, 4, 2, 20, 42, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 4, 2, 20, 43, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9e007d99-9b87-492c-9398-c1bd6aff27cb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fe295324b20>}' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:40.355569 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dac30c-6945-40ad-838f-ea6fe6117d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Apr 02 22:01:40.364928 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.flows.manager.create_volume [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Volume volume-a8432b20-c21d-485c-b932-14a2746f4034 (a8432b20-c21d-485c-b932-14a2746f4034): created successfully
Apr 02 22:01:40.368684 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dac30c-6945-40ad-838f-ea6fe6117d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129783) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Apr 02 22:01:40.374076 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Flow 'volume_create_manager' (216bcbf5-bfd4-4b01-8ab9-f25d538e9622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129783) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Apr 02 22:01:40.381383 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [None req-077530ab-a69c-4378-b807-80feb2024786 tempest-TestShelveInstance-232604610 None] Created volume successfully.
Apr 02 22:01:43.165253 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-4dea3423-72b8-44fb-807b-a19381c41b93 req-e291e512-ecb7-40a7-9ed3-5fffca1d1c7f tempest-TestShelveInstance-232604610 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 22:01:43.796922 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-4dea3423-72b8-44fb-807b-a19381c41b93 req-e291e512-ecb7-40a7-9ed3-5fffca1d1c7f tempest-TestShelveInstance-232604610 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 22:01:43.797738 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-4dea3423-72b8-44fb-807b-a19381c41b93 req-e291e512-ecb7-40a7-9ed3-5fffca1d1c7f tempest-TestShelveInstance-232604610 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8432b20-c21d-485c-b932-14a2746f4034', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'a8432b20-c21d-485c-b932-14a2746f4034', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 22:01:43.820849 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-4dea3423-72b8-44fb-807b-a19381c41b93 req-e291e512-ecb7-40a7-9ed3-5fffca1d1c7f tempest-TestShelveInstance-232604610 None] Connection info returned from driver {'name': 'volumes/volume-a8432b20-c21d-485c-b932-14a2746f4034', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8432b20-c21d-485c-b932-14a2746f4034', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8c1a0289-c3a5-4adc-873b-26b59a014e59'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 22:01:43.869595 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-4dea3423-72b8-44fb-807b-a19381c41b93 req-e291e512-ecb7-40a7-9ed3-5fffca1d1c7f tempest-TestShelveInstance-232604610 None] attachment_update completed successfully.
Apr 02 22:02:29.353785 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:02:29.354625 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:02:29.378080 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:02:29.404011 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:03:29.351073 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:03:29.351805 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:03:29.372692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:03:29.393498 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:04:14.539326 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-cdaa1cc6-f1b4-451d-a984-13f751820baf req-696431d7-d944-4b2b-bbc2-02148ad949da tempest-TestShelveInstance-232604610 None] Terminate volume connection completed successfully.
Apr 02 22:04:14.539973 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-cdaa1cc6-f1b4-451d-a984-13f751820baf req-696431d7-d944-4b2b-bbc2-02148ad949da tempest-TestShelveInstance-232604610 None] Deleting attachment 8c1a0289-c3a5-4adc-873b-26b59a014e59. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 22:04:16.814873 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-16de89fa-931d-4c72-b626-9b9e44ae6429 req-042a52c4-4c4b-486f-b63f-30200c842d47 tempest-TestShelveInstance-232604610 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 02 22:04:17.445798 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_concurrency.processutils [req-16de89fa-931d-4c72-b626-9b9e44ae6429 req-042a52c4-4c4b-486f-b63f-30200c842d47 tempest-TestShelveInstance-232604610 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.631s {{(pid=129783) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 02 22:04:17.446594 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-16de89fa-931d-4c72-b626-9b9e44ae6429 req-042a52c4-4c4b-486f-b63f-30200c842d47 tempest-TestShelveInstance-232604610 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8432b20-c21d-485c-b932-14a2746f4034', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '5a58c21e-3129-49f4-b422-749ceba5f9c4', 'volume_id': 'a8432b20-c21d-485c-b932-14a2746f4034', 'discard': True}} {{(pid=129783) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1646}}
Apr 02 22:04:17.471692 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-16de89fa-931d-4c72-b626-9b9e44ae6429 req-042a52c4-4c4b-486f-b63f-30200c842d47 tempest-TestShelveInstance-232604610 None] Connection info returned from driver {'name': 'volumes/volume-a8432b20-c21d-485c-b932-14a2746f4034', 'hosts': ['10.222.0.18'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8432b20-c21d-485c-b932-14a2746f4034', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e4691bfb-4fc9-415f-9674-7194974da4ce'} {{(pid=129783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4822}}
Apr 02 22:04:17.519258 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-16de89fa-931d-4c72-b626-9b9e44ae6429 req-042a52c4-4c4b-486f-b63f-30200c842d47 tempest-TestShelveInstance-232604610 None] attachment_update completed successfully.
Apr 02 22:04:29.349097 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:04:29.349940 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:04:29.372813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:04:29.394836 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:05:29.351072 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:05:29.351719 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:05:29.396352 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:05:29.420386 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:06:09.845362 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-7f61b121-1684-4d0f-bc45-cc8484676a04 tempest-TestShelveInstance-232604610 None] Terminate volume connection completed successfully.
Apr 02 22:06:09.846022 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.manager [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-7f61b121-1684-4d0f-bc45-cc8484676a04 tempest-TestShelveInstance-232604610 None] Deleting attachment e4691bfb-4fc9-415f-9674-7194974da4ce. {{(pid=129783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4953}}
Apr 02 22:06:09.966891 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] Lock "b'cinder-a8432b20-c21d-485c-b932-14a2746f4034-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:186}}
Apr 02 22:06:09.999153 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:06:10.072843 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] volume has no backup snaps {{(pid=129783) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1167}}
Apr 02 22:06:10.082172 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] deleting rbd volume volume-a8432b20-c21d-485c-b932-14a2746f4034 {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1321}}
Apr 02 22:06:10.328367 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] volume is a clone so cleaning references {{(pid=129783) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1342}}
Apr 02 22:06:10.357654 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] deleting parent snapshot volume-a8432b20-c21d-485c-b932-14a2746f4034.clone_snap {{(pid=129783) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1233}}
Apr 02 22:06:11.253998 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.quota [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] Created reservations ['b283f162-e734-4ff9-a3f2-85c0d2b06ac7', 'f3c82a3f-ff36-483b-8808-2a76058720a4', '031dc230-925e-4507-976c-5f0b5896107b', '4b38b2e9-a36d-4aec-ad6d-494b8c32404a'] {{(pid=129783) reserve /opt/stack/cinder/cinder/quota.py:755}}
Apr 02 22:06:11.297767 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:06:11.322919 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:06:11.351945 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:06:11.358289 ncdv-master-1 cinder-volume[129783]: INFO cinder.volume.manager [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] Deleted volume successfully.
Apr 02 22:06:11.371051 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.coordination [req-fd88e33d-e12c-4fa0-b91a-fad17eed8226 req-b84d367e-66a7-4bba-9fdd-4daea33b1da6 tempest-TestShelveInstance-232604610 None] Lock "b'cinder-a8432b20-c21d-485c-b932-14a2746f4034-delete_volume'" released by "delete_volume" :: held 1.404s {{(pid=129783) _synchronized /opt/stack/cinder/cinder/coordination.py:198}}
Apr 02 22:06:29.355793 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:06:29.356541 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:06:29.394967 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:06:29.424594 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:07:29.361239 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:07:29.361873 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:07:29.383855 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:07:29.405793 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:08:29.383785 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:08:29.384500 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:08:29.405479 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:08:29.434020 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:09:29.360040 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:09:29.360755 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:09:29.389731 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:09:29.411550 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:10:29.357218 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:10:29.357927 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:10:29.378958 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:10:29.400608 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:11:29.355262 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:11:29.355947 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:11:29.382544 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:11:29.406189 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:12:29.351491 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:12:29.352136 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:12:29.373517 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:12:29.395288 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:13:29.351812 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:13:29.352482 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:13:29.373613 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:13:29.401300 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:14:29.356111 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:14:29.356794 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:14:29.378336 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:14:29.399382 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:15:29.354611 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:15:29.355246 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:15:29.377347 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:15:29.399254 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:16:29.355856 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:16:29.356601 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:16:29.383590 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:16:29.406587 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:17:29.352875 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:17:29.353493 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:17:29.374706 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:17:29.395803 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:18:29.351106 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:18:29.351722 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:18:29.373938 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:18:29.396813 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 22:19:29.353293 ncdv-master-1 cinder-volume[129783]: DEBUG oslo_service.periodic_task [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129783) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Apr 02 22:19:29.353913 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:19:29.374287 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.volume.drivers.rbd [None req-324e3656-e49f-4775-a973-16c747d65714 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129783) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:521}}
Apr 02 22:19:29.396096 ncdv-master-1 cinder-volume[129783]: DEBUG cinder.manager [None req-324e3656-e49f-4775-a973-16c747d65714 None None] Notifying Schedulers of capabilities ... {{(pid=129783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}